server: split server.cpp code into server/common/task/queue

[ngxson]

Note: this PR is fully hand-coded, there was no AI involved as most of the copy-paste is better doing by hand.

This PR splits the server.cpp into small components:

• Main, server.cpp contains the server_context, server_slot and handler functions
• server-common containing most of the functions from utils.hpp (some one-off functions are moved to server-task)
• server-task containing all server_task_* classes and subclasses. The main idea is to consider these classes as serializer/deserialize. In the future, most of the JSON handling will be done here (instead of scattering across the code base)
• server-queue containing implementation of task queue and result queue. The goal is to group all of the mutex-related logic into one file, potentially reusing them for other things in the future (completely decoupled from other parts of server)

flowchart TD
    server_common -.- main
    server_task -.- server_slot
    server_task -.- server_queue
    server_slot <-->|update slots| server_context
    server_queue -->|get task| server_context
    HTTP_handlers -->|post task| server_queue
    subgraph main
        server_slot
        server_context -.- HTTP_handlers
    end

Loading

[ngxson]

Ok seems like windows CI are failing due to cloudflare outage: https://www.cloudflarestatus.com/incidents/8gmgl950y3h7

[pwilkin]

Yeah, the CIs are completely unreliable today due to the CloudFlare thingy.

[ngxson]

note: slot_params is renamed to task_params as I think it's a more appropriate name

[ggerganov]

I think it won't be very difficult to include just <nlohmann/json_fwd.hpp> here. For example server-queue.cpp currently indirectly includes nlohmann/json.hpp while it does not need it. We can fix this later.