PEFT BERT Model

This application can be deployed using ARM template deployment on your own Azure instance. The benefit of the deployment on your own tenant is, you can be sure that your data is not sent outside your tenant.

The application provides an interface where you can upload your own files / data to provide the model context about your business or questions. This is great for data analysis or troubleshooting or summarizing a complex piece of information.

What it needs:

1. Storage Account / Disk for storing data (should this data be deleted or kept in the storage for a set time? Should this be per user of company wide?)
2. It should have a chat interface where the user can ask questions and upload the file
3. It should have an ability to add authentication layer
4. Costing of the app needs to be determined, to provide the users with transperancy. Since model is open, there is only additional cost for the development and maintenance of the application.

Target customers:

1. We are targeting small to medium companies who want more control with AI and leverage its capabilities without compromising their data and cost.

Marketing Strategy:

1. The plan is to host this solution on Azure Marketplace as a Microsoft Partner

Additional layer to be built

1. Checking if any personal information is being used
2. Any biasis in the result (profiling)
3. Prompt injection should be monitored!!!
4. GuardRails for prompts (input/output)