MEGA - Build a company in the EU that serves GDPR compliant deepseek calls

It would requires some cards but technically all is done.

backend is:

ollama run deepseek-r1:671b

and the front end can be chosen from a lot of MIT ollama interfaces.
The above command runs on 8 Γ— 80 GB A100 and works quite well.

Ofc you need to scale for usage. I got some experience in that.https://x.com/PascalBauerDE/status/1883672122356380145

Please authenticate to join the conversation.

Upvoters
Status

Open

Board

eu/acc

Date

About 1 year ago

Subscribe to post

Get notified by email when there are changes.