Skip to content

User and Model Management - #275

Closed
locnguyen1986 wants to merge 67 commits into
releasefrom
main
Closed

locnguyen1986 wants to merge 67 commits into
releasefrom
main

Conversation

@locnguyen1986

Copy link
Copy Markdown
Collaborator
  • Admin API endpoints for user, group, and feature flag management with Keycloak integration
  • Model catalog enhancements with feature flags, experimental model support, and capability filtering
  • Database schema updates for feature flags, audit logging, and model display/ordering
  • Middleware for admin authorization, rate limiting, and feature flag checking

…tion-crud

Add the workspace API for CRUD, conversation related stuff
)

### Added
- Consolidated Makefile structure (single file with 10 sections)
- Hybrid development mode for faster iteration
- MCP (Model Context Protocol) provider integration
- Full observability stack (Prometheus, Jaeger, Grafana)
- OpenTelemetry integration
- Guest authentication with Keycloak token exchange
- Comprehensive testing suite with Newman
- Documentation for all major features

### Changed
- Restructured project from monolithic to microservices architecture
- Updated to PostgreSQL 16
- Migrated to Kong 3.5 API Gateway
- Improved Docker Compose organization with profiles

### Removed
- Modular Makefile files (consolidated into single Makefile)
- Legacy authentication system
* update docs

* clean document update

* remove suffix
* update docs

* clean document update

* remove suffix

* add temp solution on new kong auth

* fix port

* fix api_key access

* fix

* fix responses

* update helm chart
* fix auth documents

* update auth docs

* project init

* add project with new docs

* add project testings

* remove unused docs
locnguyen1986 and others added 25 commits November 14, 2025 01:33
* add swagger config in kong

* fix auth

* fix auth redirect + conversation proj

* hard code for testing

* add conversation and redirect features

* fix getMe
* add more logging in keycloak auth

* rollback debug, comment idTokens
Configuration System: Created new centralized configuration documentation in docs/configuration/ with comprehensive guides for precedence, environment variable mapping, Docker Compose integration, and Kubernetes Helm values generation
Documentation Consolidation: Merged multiple testing documents into single comprehensive guides, moved CLI documentation to main docs directory, and updated IDE integration guides to reference current tooling
Command Reference Updates: Replaced deprecated commands with current jan-cli commands and make targets throughout all documentation
Convention Guides: Added comprehensive convention documents covering architecture patterns, design patterns, workflow, and quick reference conventions for developers
* fix typo

* add typo
Add responses with queue tasks and webhook
Add db migrations for both media and response feature
Structure the configurations
Formalize all e2e tests
Introduced consistent platformerrors package across template-api, response-api, media-api, and mcp-tools services with structured error types and HTTP status mapping
Renamed HttpServer to HTTPServer across all services for proper Go naming conventions
Reorganized mcp-tools service with proper internal/ structure and consolidated middleware/response handling
Improved variable naming throughout (e.g., raw → levelString, s → input, base → baseURL)
* rework on monitoring

* fix config drift
* fix auth and user context

* remove unused tasks
* use prod inference server

* fix service, reload

* add log to trigger prod build
* add memory todo

* add prompt orchestration todo

* temp code

* finalize prompt orchestration

* add memory tools

* add temp memory code

* memory tools improve code

* fix keycloak logout

* remove todos

* Delete bge-m3-quick-start.md
- Updated golang-jwt/jwt/v5 from various versions (5.0.0, 5.2.1) to v5.3.0 across all services
- Upgraded golang.org/x/* packages (crypto, net, sys, text, tools, mod, sync) to newer versions
- Updated PostgreSQL-related libraries (jackc/pgx/v5, jackc/pgservicefile) to latest versions
- Upgraded QUIC-related packages in mcp-tools/tools/vector-store-service
fix golang.org/x/crypto as an indirect dependency
* Initial plan

* Fix: replace make monitor-dev with make monitor-up in cmd_setup.go

Co-authored-by: louis-jan <133622055+louis-jan@users.noreply.github.com>

* Remove accidentally committed jan-cli binary and add to gitignore

Co-authored-by: louis-jan <133622055+louis-jan@users.noreply.github.com>

---------

Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: louis-jan <133622055+louis-jan@users.noreply.github.com>
Memory MCP Integration: New memory_retrieve MCP tool with JWT-based authentication for user context extraction
User Settings System: Complete CRUD API for user preferences including memory configuration, profile settings, and feature toggles stored in JSONB columns
Configuration Changes: Default values for memory and prompt orchestration features changed from true to false (breaking change)
Adds base_style enum (Concise, Friendly, Professional) to profile settings with "Friendly" as default
Implements project instruction loading and injection via both direct prepending and ProjectInstructionModule
Renames nickname to nick_name with backward-compatible JSON unmarshaling
- Implemented a lightweight Go-based API test runner (cmd/jan-cli/cmd_apitest.go) that reads Postman collections and executes requests
- Added MCP_ENABLE_PYTHON_EXEC and MCP_ENABLE_MEMORY_RETRIEVE configuration flags for runtime control of MCP tool availability
- Updated all documentation, Makefile targets, and CI examples from Newman to jan-cli api-test
- Pinned vLLM Docker image to v0.11.2 instead of latest
improve prompt orchestration (#268)
- add dev-test for dev server
- fix build conditions
Admin API endpoints for user, group, and feature flag management with Keycloak integration
Model catalog enhancements with feature flags, experimental model support, and capability filtering
Database schema updates for feature flags, audit logging, and model display/ordering
Middleware for admin authorization, rate limiting, and feature flag checking
Copilot AI review requested due to automatic review settings December 5, 2025 13:51

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR removes significant portions of user and organization management code, authentication infrastructure, database operations, and API routes. The changes appear to be part of a major refactoring that eliminates file-based code in favor of what the PR title suggests will be replaced with Keycloak-integrated admin APIs and enhanced model catalog features.

Key changes:

  • Removed authentication routes (Google OAuth, guest login, JWT middleware)
  • Removed user, organization, project, and API key management infrastructure
  • Removed database schemas, repositories, and migration code
  • Removed response handling for both streaming and non-streaming operations
  • Removed HTTP server configuration and middleware (CORS, logging, transaction management)

Reviewed changes

Copilot reviewed 102 out of 735 changed files in this pull request and generated no comments.

Show a summary per file
File Description
Multiple route files (chat, auth, google) Removed all authentication and chat routing logic
Response handling files Removed streaming and non-streaming response structures
Middleware files Removed CORS, logging, transaction, and JWT authentication middleware
Repository files Removed all database repository implementations for users, projects, organizations, API keys, responses, conversations, items, and invites
Database schema files Removed all GORM schema definitions and database migration logic
Domain service files Removed user service, query utilities, and domain models
Infrastructure files Removed database connection logic, inference providers, and cache constants

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

@github-project-automation github-project-automation Bot moved this to Done in Jan Dec 5, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

4 participants