Skip to main content

Introduction

Overview

The LLM SDK supports integration between applications running on the 42dot Pleos Vehicle OS and the 42dot LLM platform, offering both On-Device and Server modes. The LLM delivers result text to the app based on the user's input. The LLM SDK interacts with the LLM AI service, enabling applications to generate plans and engage in conversations tailored to the automotive environment.

[No backward compatibility support]
  • Apply the updated package naming. (Modify module-level build.gradle and import statements)
  • Apply the updated permission naming in the manifest file.
  • Re-download the Pleos Connect Emulator.

Development Environment Setup

To use the LLM SDK, install the Pleos Connect Emulator in Android Studio and proceed with AVD setup.

LLM API

The list of APIs provided by the LLM SDK is as follows.

FunctionSummary
initialize APIAPI to initialize the LLM SDK.
release APIAPI to release the LLM SDK.
generateContent APIAPI to generate a result based on the app's input data source and deliver it to the app in real time, returning a response for a single request.
startChat APIAPI to start a conversation with the LLM service.
sendMessage APIAPI to support conversation and chat features by generating a result based on the app’s input data source and delivering it in real time, while incorporating conversation history into the response.
setModelParameter APIAPI to allow users to update the LLM model and configuration settings to their desired values.
registerApp APIAPI to register an app to use server-based LLM functionality.