{"id":75,"date":"2024-03-28T10:07:48","date_gmt":"2024-03-28T10:07:48","guid":{"rendered":"https:\/\/routeburn.be\/?p=75"},"modified":"2024-03-28T10:10:55","modified_gmt":"2024-03-28T10:10:55","slug":"newest-model-from-databricks-dbrx-is-best-in-class-in-the-category-open-source","status":"publish","type":"post","link":"https:\/\/routeburn.be\/?p=75","title":{"rendered":"Newest model from Databricks DBRX is best in class in the category open-source"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\"><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Databricks released a new open-source LLM surpassing all other open-source LLMs on all benchmarks and even surpassing OpenAI&#8217;s proprietary  GPT-3.5 model, closing in on GPT-4 (which recently got beaten by Anthropic Claude-3 model).<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">As you can see there is a lot going on in the world of LLMs, which is not about to stop soon, unless we run out of GPU&#8217;s&#8230;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Luckily researchers are getting more clever in their architectures as they also see that not only bigger (requiring more GPU) will be the path forward. That&#8217;s why models like DBRX are more interesting. They make use of MoE (mixture of experiments), which are in the end, more intelligent building blocks of LLMS. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Test it on Huggingface<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/huggingface.co\/spaces\/databricks\/dbrx-instruct\">https:\/\/huggingface.co\/spaces\/databricks\/dbrx-instruct<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Databricks released a new open-source LLM surpassing all other open-source LLMs on all benchmarks and even surpassing OpenAI&#8217;s proprietary GPT-3.5 model, closing in on GPT-4 &hellip;<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[10],"tags":[6,8,5,7,9],"class_list":["post-75","post","type-post","status-publish","format-standard","hentry","category-generative-ai","tag-databricks","tag-huggingface","tag-llm","tag-moe","tag-open-source"],"_links":{"self":[{"href":"https:\/\/routeburn.be\/index.php?rest_route=\/wp\/v2\/posts\/75","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/routeburn.be\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/routeburn.be\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/routeburn.be\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/routeburn.be\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=75"}],"version-history":[{"count":1,"href":"https:\/\/routeburn.be\/index.php?rest_route=\/wp\/v2\/posts\/75\/revisions"}],"predecessor-version":[{"id":77,"href":"https:\/\/routeburn.be\/index.php?rest_route=\/wp\/v2\/posts\/75\/revisions\/77"}],"wp:attachment":[{"href":"https:\/\/routeburn.be\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=75"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/routeburn.be\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=75"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/routeburn.be\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=75"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}