David Erickson’s Post

DeepSeek R1 is big moment for local inferencing. I've played with it locally on ollama and LMStudio ... but for those who don't want to mess with local hosting, Groq runs a great inferencing service. Because of their OpenAI API compatibility layer you can plug it right into Kibana's Playground and AI Assistants for testing

  • graphical user interface, text, application, email
Daren Presbitero

CISSP | Impacting the Cyber Mission @ Thundercat Technology

1w

Curious what your initial take is on the model David Erickson?

Like
Reply
Rob S.

Digital Transformation Expert | IT Strategy | Business Operations | Agile Leader | Management Consultant

1w

That's good news for those of us who aren't as comfortable with local hosting (esp. in a secure way). Seems like Groq's inferencing service and OpenAI API compatibility layer make it somewhat accessible to experiment with DeepSeek R1 (in Kibana). Thanks for the heads-up.

Like
Reply
Steve Stemmer

Public Sector Technology Champion | AI/ML Enthusiast | Opensource Evangelist

1w

Great share Dave. Thanks for the tips!

Like
Reply
See more comments

To view or add a comment, sign in

Explore topics