Introduction
Overview
The LLM SDK supports integration between applications running on the 42dot Pleos Vehicle OS and the 42dot LLM platform, offering both On-Device and Server modes. The LLM delivers result text to the app based on the user's input. The LLM SDK interacts with the LLM AI service, enabling applications to generate plans and engage in conversations tailored to the automotive environment.
[No backward compatibility support]
- Apply the updated package naming. (Modify module-level build.gradle and import statements)
- Apply the updated permission naming in the manifest file.
- Re-download the Pleos Connect Emulator.
Development Environment Setup
To use the LLM SDK, install the Pleos Connect Emulator in Android Studio and proceed with AVD setup.
LLM API
The list of APIs provided by the LLM SDK is as follows.
Function | Summary |
---|---|
initialize API | API to initialize the LLM SDK. |
release API | API to release the LLM SDK. |
generateContent API | API to generate a result based on the app's input data source and deliver it to the app in real time, returning a response for a single request. |
startChat API | API to start a conversation with the LLM service. |
sendMessage API | API to support conversation and chat features by generating a result based on the app’s input data source and delivering it in real time, while incorporating conversation history into the response. |
setModelParameter API | API to allow users to update the LLM model and configuration settings to their desired values. |
registerApp API | API to register an app to use server-based LLM functionality. |