AI is the rise of inding linguists shaping global language models | Bengaluru News

AI News


ai burns the rise of inding linguists shaping global language models

Bengaluru: As AI companies push their models to make them relevant in culture and regions, language expertise has emerged as an important skill in the AI ​​economy. AI is driving the rise of linguists designing prompts to test models about cultural nuance, bias, and taboos. Benchmark responses of tone, accuracy and cultural adequacy. Review the dataset to make sure it reflects a variety of contexts. Opportunities are accelerating for Indian linguists, especially in underrated languages. Some US companies and recruitment platforms list rates ranging from $10 to $50 per hour, reflecting increased demand for projects and varying periods.For example, talent mates from the recruitment platform were promoted for Indian national cultural and linguistic experts with the ingenuity of Indian languages ​​to train and evaluate AI models. This list sought advanced degrees in sociolinguistics, anthropology, history, or cultural studies. Similarly, Sigma Ai, a data labeling and annotation company based in Madrid, has published a remote opening for linguists in Telugu. Demand is also growing in major tech companies. According to a report by Business Insider, Meta has pointed out that he is working with local people in markets such as India, Indonesia and Mexico to hire contractors to develop AI-powered chatbot characters. The report said it was paying up to $55 for fluent workers in Hindi, Indonesian, Spanish and Portuguese, according to job statements reviewed by Business Insider. In India, Krutrim recently published the role of Kannada linguists in training and assessment of AI. This included fine-tuning through dataset curation, linguistic model evaluation, and reinforcement learning from human feedback (RLHF).Nishad Acharya, head of talent networks at our AI startup Turing, said the work is moving from simple annotations to higher order tasks such as inference calibration, cultural safety reviews and multimodal grounding. “Linguistic diversity is one of India's biggest assets in the AI ​​era. Languages ​​like Kannada, Punjabi and Bengali are underestimated in today's models, but they are changing quickly. There is a great opportunity not only for language experts, but also for the interdisciplinary talent that can fine-tune AI systems for healthcare, education and funding. people. This requires people who understand not only the language to make AI more comprehensive and impactful, but also the local context.Acharya noted that RLHF is most effective when feedback is subtle and culturally grounded. “Fine-tuning the multilingual model has greatly improved flow and relevance when feedback comes from native speakers as well as translated datasets,” he said. Manish Gupta, senior director of Google Deepmind, highlighted his efforts to strengthen Indian language AI. “We have been working with our global team on the next big leap in a more effective Indian language model. Our Indian capabilities power Gemma, a family of Google's powerful yet lightweight open models for Gemini-based developers. He said. We are also committed to building multicultural understanding in our linguistic models to fill the final miles between AI's linguistic capabilities and true cultural understanding,” Gupta added.





Source link

Leave a Reply

Your email address will not be published. Required fields are marked *