Synthesized Function

A SynthesizedFunction is a key functionality offered within the Flappy. This powerful feature interacts with Large Language Models (LLMs) and requires only the definition of its description, inputs, and outputs, significantly simplifying the process of AI integration in your projects.

SynthesizedFunction is designed to delegate the execution logic to the underlying LLM, such as GPT-3.5 Turbo. This approach allows developers to describe what they want the function to achieve, leaving the execution details to the LLM.

Usage

Creating a SynthesizedFunction involves specifying a description, along with the structures of the inputs and outputs. These definitions can be made using your preferred programming language, enhancing ease-of-use and accessibility. Flappy then parses these definitions using Abstract Syntax Tree (AST) parsing to transform them into a JSON Schema schema for machine readability and interoperability.

Here's a typical example of a SynthesizedFunction:

NodeJS (TypeScript)

import { createSynthesizedFunction, z } from '@pleisto/node-flappy'

createSynthesizedFunction({
  name: 'getMeta',
  description: 'Extract meta data from a lawsuit full text.',
  args: z.object({
    lawsuit: z.string().describe('Lawsuit full text.')
  }),
  returnType: z.object({
    verdict: z.nativeEnum(Verdict),
    plaintiff: z.string(),
    defendant: z.string(),
    judgeOptions: z.array(z.string())
  })
})

Java

  public static FlappyFunctionBase<?, ?> lawGetMeta = new FlappySynthesizedFunction(
    "getMeta",
    "Extract meta data from a lawsuit full text.",
    LawMetaArguments.class,
    LawMetaReturn.class
  );

  static class LawMetaArguments {
    @FlappyField(description = "Lawsuit full text.")
    String lawsuit;

    public String getLawsuit() {
      return lawsuit;
    }

    public void setLawsuit(String lawsuit) {
      this.lawsuit = lawsuit;
    }
  }

  public static class LawMetaReturn {
    @FlappyField
    Verdict verdict;

    @FlappyField
    String plaintiff;

    @FlappyField
    String defendant;

    @FlappyField
    List<String> judgeOptions;

    public Verdict getVerdict() {
      return verdict;
    }

    public void setVerdict(Verdict verdict) {
      this.verdict = verdict;
    }

    public String getPlaintiff() {
      return plaintiff;
    }

    public void setPlaintiff(String plaintiff) {
      this.plaintiff = plaintiff;
    }

    public String getDefendant() {
      return defendant;
    }

    public void setDefendant(String defendant) {
      this.defendant = defendant;
    }

    public List<String> getJudgeOptions() {
      return judgeOptions;
    }

    public void setJudgeOptions(List<String> judgeOptions) {
      this.judgeOptions = judgeOptions;
    }
  }

Kotlin

val lawGetMeta = FlappySynthesizedFunction(
  name = "getMeta",
  description = "Extract meta data from a lawsuit full text.",
  args = LawMetaArguments::class.java,
  returnType = LawMetaReturn::class.java,
)

class LawMetaArguments(
  @FlappyField(description = "Lawsuit full text.")
  val lawsuit: String
)

class LawMetaReturn(
  @FlappyField
  val verdict: Verdict,

  @FlappyField
  val plaintiff: String,

  @FlappyField
  val defendant: String,

  @FlappyField
  val judgeOptions: List<String>
)

C#

new SynthesizedFeature<GetMeta_Args,GetMeta_Return,FlappyFeatureOption>(new SynthesizedFeatureDefinition<GetMeta_Args,GetMeta_Return>
{
    Name = "getMeta",
    Description = "Extract meta data from a lawsuit full text.",
    Args = new GetMeta_Args(),
    ReturnType = new GetMeta_Return()
}),

internal class GetMeta_Args
{
  [Description("Lawsuit full text.")]
  public string Lawsuit { get; set; }

  public override string ToString()
  {
    return JObject.FromObject(this).ToString();
  }
}

[JsonObject(ItemRequired = Required.Always)]
public class GetMeta_Return
{
  [JsonConverter(typeof(StringEnumConverter))]
  [DefaultValue(Verdict.Unknow)]
  public Verdict Verdict { get; set; } = Verdict.Unknow;

  public string Plaintiff { get; set; } = string.Empty;

  public string Defendant { get; set; } = string.Empty;

  public string[] JudgeOptions { get; set; } = Array.Empty<string>();

  public override string ToString()
  {
    return JObject.FromObject(this).ToString();
  }
}

In this scenario, the getMeta function is aimed at extracting metadata from a lawsuit text. The function takes a lawsuit text string as input and returns an object containing the verdict, plaintiff, defendant, and judge options.

Benefits

The SynthesizedFunction presents several key advantages:

1. Simplicity: Developers need only define the function's purpose, inputs, and outputs, freeing them from the complexities of implementation details.
2. Flexibility: The feature allows for defining intricate functions without explicitly programming the logic, lending to robust design possibilities.
3. Efficiency: SynthesizedFunction capitalizes on AI's power to handle complex data processing tasks, enhancing productivity.

By harnessing SynthesizedFunction in the Flappy SDK, developers can more effectively incorporate AI into their applications, achieving new levels of reliability and efficiency.

Error Handling

The SynthesizedFunction feature is designed to be robust and reliable. Flappy will validate the LLM's response and try to repair it if it is invalid. If the response is still invalid, Flappy will throw an error.

Credits

This feature is inspired by the Microsoft's TypeChat project.