Aimon ReAct (Reason and Act) #52

devvratbhardwaj · 2024-12-23T20:31:09Z

AIMon ReAct functionality to handle LLM hallucinations and instruction non-compliance.

…ll hallucinated after n number of max attemps

…omprises of llm_responses and respecitve hallucination score.

…, a list of hallucination scores and a boolean value for adhered instuctions

…n notebook

aimon/extensions/react.py

Refreshing the aimon-react branch with the latest changes

devvratbhardwaj added 6 commits December 21, 2024 00:52

A new directory created for reprompting extension

99f09e3

First iteration of AIMon ReAct (Reason and Act)

1bd78d6

updated parameters for context_extractor

560324f

added the instruction adherence logic to AIMon ReAct

12cc161

passing hallucination score to modify the new prompt dynamically

e3beac6

added condition and logic to handle the case when the response is sti…

e354ff5

…ll hallucinated after n number of max attemps

devvratbhardwaj marked this pull request as ready for review December 24, 2024 17:29

devvratbhardwaj force-pushed the aimon-react branch from 9d132b4 to e354ff5 Compare December 26, 2024 21:30

class React

f2049d0

devvratbhardwaj force-pushed the aimon-react branch from df8c1d7 to f2049d0 Compare December 26, 2024 22:39

devvratbhardwaj added 4 commits December 27, 2024 04:10

added more methods to the class React

0eb154d

modified some parameters in the ReactConfig dataclass to be optional

b6cce90

removed Detect from aimon import

aa4e6f4

updated the react method to returns a list of lists where each list c…

4cd39f2

…omprises of llm_responses and respecitve hallucination score.

devvratbhardwaj force-pushed the aimon-react branch from 7ab5570 to 4cd39f2 Compare January 13, 2025 19:01

devvratbhardwaj added 2 commits January 14, 2025 00:47

returning a result dictionary consiting of a list of response strings…

4e10bf9

…, a list of hallucination scores and a boolean value for adhered instuctions

updated result logic with 4 edge cases

92e91f9

devvratbhardwaj force-pushed the aimon-react branch from 0c77121 to 92e91f9 Compare January 13, 2025 20:14

devvratbhardwaj added 4 commits January 14, 2025 01:44

introduced react score and some assumptions.

94e6af4

updated keys in the result dictionary

6082066

updated adherence logic

abbf007

commented some logic that should rather be included in the applicatio…

e962037

…n notebook