4 papers
BluTrain: A C++/CUDA Framework for AI Systems
Adhitya Charan, Adwaid Suresh, Anuj Kumar +19
Progress in deep learning is, at scale, more a matter of systems engineering than of modelling: the behaviour of a model in training (its throughput, its memory footprint, and the…
State-of-the-art Small Language Coder Model: Mify-Coder
Abhinav Parmar, Abhisek Panigrahi, Abhishek Kumar Dwivedi +93
We present Mify-Coder, a 2.5B-parameter code model trained on 4.2T tokens using a compute-optimal strategy built on the Mify-2.5B foundation model. Mify-Coder achieves comparable a…
EnterpriseEM: Fine-tuned Embeddings for Enterprise Semantic Search
Kamalkumar Rathinasamy, Jayarama Nettar, Amit Kumar +24
Enterprises grapple with the significant challenge of managing proprietary unstructured data, hindering efficient information retrieval. This has led to the emergence of AI-driven…
Narrow Transformer: StarCoder-Based Java-LM For Desktop
Kamalkumar Rathinasamy, Balaji A J, Ankush Kumar +6
This paper presents NT-Java-1.1B, an open-source specialized code language model built on StarCoderBase-1.1B, designed for coding tasks in Java programming. NT-Java-1.1B achieves s…