Meet the Clarifai Champs of the Streamlit LLM Hackathon

In September, Clarifai was excited to be a part of an LLM Hackathon hosted by Streamlit. The Hackathon was meant to nurture creativity within the improvement of AI-first merchandise utilizing highly effective LLMs.

Constructing with LLMs and different fashions from Clarifai group

The problem required individuals to create a Streamlit app by using know-how from Clarifai and 4 different companions: LangChain, AssemblyAI, Weaviate, and LlamaIndex.

A complete of 36 spectacular tasks had been constructed utilizing Clarifai and submitted for judging. With so many nice entries, choosing two Clarifai winners proved difficult! Listed here are the tasks that stood out essentially the most!

Winner: GPT Analysis Buddy

GPT Analysis Buddy, one of many winners, is a Q&A and summarization bot leveraging the Nougat Transformer to learn analysis papers from sources like Arxiv and the ACL Anthology. It makes use of LLamaIndex to create a vector-based index for Q&A discussions and likewise leverages GPT 3.5 Turbo, Open AI’s Textual content Embedding, and Textual content Moderation fashions from the Clarifai Group, together with the Nougat Transformer.

Here is how GPT Analysis Buddy works:

1. With the user-provided URL of the arXiv or ACL Anthology analysis paper, it makes use of Nougat Transformer to learn the paper contents and get the markdown illustration of the paper.
2. Subsequent, it makes use of LLamaIndex to create a vector-based index for Q&A discussions to generate key insights from the paper, parallelly spinning up a customized chatbot engine.
3. Now, you possibly can ask the chatbot questions particular to the analysis paper. Earlier than answering, the question can be handed by means of a moderation engine, which decides whether or not the question is poisonous, hateful, or biased, utilizing Clarifai’s textual content moderation mannequin.

Winner: Persona Simulator

Persona Simulator options 5 totally different personas, every with their very own personalities, latest actions, objectives, and a set of obtainable instruments to find out their actions. These personas can create paintings, compose weblog posts, and share social media updates. The venture makes use of the Steady Diffusion XL 1.0 and GPT-4 fashions from the Clarifai Group.

Here is how Persona Simulator works:

The app incorporates a number of distinct personas, every represented by a paragraph of textual content, a listing of pursuits, a bodily description, and a writing type description. It additionally has entry to a wide range of instruments for inside reflection and exterior expression. Moreover, a workflow has been established wherein every persona is guided independently to pick out a job primarily based on the instruments they will entry. Subsequently, they plan the best way to execute the duty after which proceed to do it.

To get began, you choose a persona of your alternative and provides them their subsequent thought. Because it progresses, you can see their thought course of as they collect analysis, journal about their emotional response, create artwork and make numerous sorts of postings.

The instruments accessible to the 5 AI personas embrace:

1. Learn the most recent blogs: Retrieves the contents of the final three weblog posts for continuity.
2. Learn from journal: Retrieves the contents of the final three journal entries.
3. Create artwork: Generates numerous types of artwork, reminiscent of images, work, and digital artwork.
4. Write in journal: Data info in a journal, facilitating thought processing after duties like QueryForInfo.
5. Submit on social media: Shares quick messages on social media, optionally together with pictures created utilizing CreateArt.
6. Write weblog put up: Permits writing long-format weblog posts for quick publication.
7. Question for information: Serves as the first interface for asking questions and buying info for use in weblog entries.

Congratulations to those two winners!!

Honorable mentions🏆

Try another superior tasks beneath – the Honorable Mentions. Notice that they’re listed in no explicit order.

DocuTalk

DocuTalk is an LLM-powered chatbot that makes use of Clarifai’s documentation (Clarifai docs) as its information base and solutions questions.  It additionally leverages the embedding mannequin together with GPT-4 accessible within the Clarifai Group. 

Tube-to-Textual content-Coach

Tube-to-Textual content-Coach is a exercise companion that transforms follow-along train movies into health routines.  Enter your favourite exercise video and it creates a exercise routine leveraging GPT-4 accessible within the Clarifai Group.

Design Assist

Design Assist is a design assistant that helps information the design course of by means of questions, drawback assertion technology, product mock-ups, a pattern person journey, interviews from digital customers, and report technology. This makes use of Open AI embeddings, GPT-4, content material moderation, and Steady Diffusion XL fashions all accessible within the Clarifai Group. 

Remaining Phrases

Because of Streamlit for partnering and internet hosting this hackathon and a particular because of the opposite companions LangChain, AssemblyAI, Weaviate, and LlamaIndex. Additionally congratulations to the a whole bunch of hackers that got here collectively to construct, be taught, and have enjoyable. We love seeing your nice concepts, vitality, and collaboration. As soon as once more we’re impressed with the quantity and high quality of the tasks constructed with Clarifai.