Been stuck on a unique NLP problem [D]

Reddit r/MachineLearning News

Summary

Developer seeks advice on handling English-Hindi code-mixed text classification without heavy LLMs, as sentence transformers fail on Romanized Hindi.

So basically, I am developing an app where I would need to classify the texts. The problem is the texts can be in English, Hindi and hindi+english(Hindi language written with English alphabets). So naturally I chose the way of sentence transformer for it but the main problem is it fails abysmally on Hindi+English. There seems to be zero semantic meaning to the model of these type of tasks. I know LLM is a solution for this but my application would be too heavy with it. I thought of transliteration but that seems to be inaccurate and corrupting the text Is anyone else faced a similar type of issue? What direction should I take?
Original Article

Similar Articles

Multilingual-Multimodal-NLP/LoopCoder-V2 · Hugging Face

Reddit r/LocalLLaMA

LoopCoder-V2 is a 7B instruction-tuned code model built on the Parallel Loop Transformer (PLT), demonstrating non-monotonic test-time scaling with two loops providing the best gain-cost trade-off and significant improvements over baselines on code generation and reasoning benchmarks.