AAC

Made a sample UI that allows to give input image and generate sentence. The model output varies like below. I am trying to figure out the method to filter the output.

For eg: Given Prompt "construct 5 basic proper sentences about {input word} and its habits for primary school students"

AI output

Step 1/5
1. Parrots are beautiful birds that come in many different colors and sizes.

Step 2/5
2. Parrots are very smart and can learn many tricks and even talk.

Step 3/5
3. Parrots are social birds and love to be around other parrots and people.

Step 4/5
4. Parrots need a lot of attention and exercise to stay healthy.

There should be a Due Date for every task and an updated %Done. Cannot work without any deadlines.

• Do we have a creative common license to use these images?
• How are you imagining the use case, is this set up by a teacher, and the child clicks on a button, or is the child supposed to upload an image?
• This is not picture to speech (think AI into HOPE...as the subject of this Issue). I am expecting a communication tool, where a user selects 1 or more images from the KAVI-PTS library, AI generates a few possible sentences, and the child picks one of them.

Do we have a creative common license to use these images?
I will use the KAVI Library images

How are you imagining the use case, is this set up by a teacher, and the child clicks on a button, or is the child supposed to upload an image?
This is a sample UI we decided to create and show it to special educators in Mira school to get their ideas on the requirement. So we can plan the development in both Hope and Kavi-PTS based on their feedback

The sample use cases I have considered are below

1. AI to generate Sentences with the "Thank You, Sorry, Nice to meet you" which children can use. These are the pictures under Quick talk in the Kavi Library
2. Common sentences used by the children in Classroom. Class room is also the picture from our image Library

The respective AI responses for the above inputs are uploaded.

I made a UI to display the images. Images can be select/deselect on clicking. Once selecting the images, Clicking on Generate sentences will display the possible sentences with the keywords(image names).

I am sharing the sample outputs of the sentences generated by gemma model.

Prompt used "Generate sentences suitable for children using the all the key words. Make the sentences short, simple, and conversing. ";

Need to try with different prompts and have to run different models to compare the results