Welcome to AgentNovaX! πβ¨
At AgentNovaX, our vision is to create a world where innovation, collaboration, technology, and sustainability work hand-in-hand to empower communities. We aim to provide tools that simplify tasks, increase productivity, and contribute to a better planet. Through creativity, inclusivity, and environmental consciousness, we strive to inspire a global movement toward shared success and continuous growth. π±π‘
This project is a Spring Boot API that leverages Spring AI, Ollama, and the DeepSeek 1.5B LLM model to provide intelligent responses and perform advanced natural language processing (NLP) tasks. It is designed to explore the capabilities of the DeepSeek model while comparing it with other LLMs and techniques such as O1 and examining training methodologies like supervised fine-tuning and reinforcement learning.
- Integration with Spring AI: Simplifies the usage of large language models (LLMs) in Spring applications.
- Ollama Compatibility: Uses the Ollama framework for seamless model hosting and interaction.
- DeepSeek 1.5B Model: Incorporates the advanced DeepSeek 1.5B parameter model for NLP tasks.
- RESTful Endpoints: Provides APIs to interact with the model for tasks like text generation and classification.
| Dependency | Version | Description |
|---|---|---|
Spring Boot |
3.x+ | Framework for building Java-based applications. |
Spring AI |
Latest | Simplifies AI model integration in Spring projects. |
Ollama |
Latest | A tool for hosting and managing LLMs locally or in the cloud. |
DeepSeek 1.5B |
- | A compact, fine-tuned LLM optimized for balanced performance and usability. |
- Efficiency: A smaller model size (1.5B parameters) means faster inference times compared to larger LLMs like GPT-3.
- Fine-Tuned Performance: Designed for specific domains with high accuracy.
- Cost-Effective: Requires less computational power for deployment and inference.
- Open Ecosystem: Supports integration with popular frameworks like Ollama and Spring AI.
- Limited Generalization: Smaller models may struggle with broad, diverse tasks compared to models with tens of billions of parameters.
- Less Knowledge Depth: May lack the extensive training data coverage found in models like GPT-4 or LLaMA 2.
- Scaling Issues: Not ideal for handling very complex queries or tasks requiring reasoning over extensive context.
| Feature | DeepSeek 1.5B | O1 | GPT-4 | LLaMA 2 |
|---|---|---|---|---|
| Model Size | 1.5B parameters | 1.3B parameters | ~175B parameters | 7B/13B/70B variants |
| Inference Speed | β‘ Fast | β‘β‘ Faster | π’ Slower | β‘β‘ Faster |
| Domain-Specific | β Yes | β Yes | β Broad | β Broad |
| Cost to Run | π² Low | π² Low | π° High | π² Moderate |
| Open Source | β Yes | β Yes | β No | β Yes |
- Definition: Involves training a model on a labeled dataset where correct input-output pairs are known.
- Pros:
- Easier to implement.
- Produces predictable and consistent outputs.
- Effective for domain-specific applications.
- Cons:
- Limited by the quality and size of the training dataset.
- Cannot adapt dynamically to new scenarios.
- Definition: Uses feedback from humans or other agents to fine-tune a model iteratively.
- Pros:
- Enables more nuanced, human-like responses.
- Adaptive to broader tasks and diverse use cases.
- Cons:
- Computationally expensive.
- Requires complex setup and manual feedback loops.
git clone <repository-url>
cd springboot-ai-apiAdd your configuration in application.yml:
spring:
ai:
model: deepssek-1.5b
ollama:
host: localhost
port: 11400./mvnw spring-boot:runGET /prompt- Headers:
Content-Type: application/json - Parameter:
?prompt=Write a short story about AI. - Response:
Once upon a time, an AI learned empathy...
- Integration with more models like GPT-4 and LLaMA 2.
- Support for distributed inference using Kubernetes.
- Advanced fine-tuning features via reinforcement learning.
Licensed under the Apache License, Version 2.0. - see the LICENSE file for details.
Stay connected with AgentNovaX through our social media channels:
- X (Twitter) π¦
- LinkedIn π
- Instagram πΈ
- Facebook π
- YouTube π₯
NovaLeaf is an initiative focused on environmental sustainability, aiming to contribute to a greener planet. Through this initiative, AgentNovaX is committed to planting trees, fostering green projects, and encouraging eco-friendly practices among individuals and communities.
- Plant a Tree, Empower a Community: For every milestone achieved in our platform, a tree will be planted in a designated area.
- Green Nova Trees: These trees represent our growth and commitment to sustainability, and each one is named for the cause it supports.
- Join the Movement: Become part of the NovaLeaf family and help us plant the future, one tree at a time. π³
π Please consider starring this repository to support the NovaLeaf initiative π
For more information, visit NovaLeaf.
DataFlux provides free tools for data conversion, JSON/YAML beautification, and validation to help developers and data enthusiasts streamline their workflow.
- Tools available: JSON/YAML Beautifiers and Validators, JSON/YAML conversion, Text Compare, JavaScript Validators, and more.
- Visit DataFlux to explore our tools and enhance your productivity.
