A US-based AI chip startup, Groq, is reportedly seeking £500m in internal funding as it pivots from hardware development to focus more on AI inference, a key process in refining the way AI models respond to prompted requests, according to Axios.
AI inference is the process of refining the decisions made by AI models, ensuring that their responses are accurate and relevant. This is a crucial step in making AI more reliable and trustworthy, especially in critical applications such as healthcare and finance.
Groq's decision to shift focus from hardware to AI inference comes amidst significant investment in the AI chip market. Nvidia, a leading chip manufacturer, recently acquired British chip designer Arm for £31.4bn, while UK-based chipmaker Graphcore raised £200m in funding in 2020.
Regulatory bodies, including the UK's Information Commissioner's Office (ICO) and the EU's AI Act, are also playing a key role in shaping the future of AI development. The EU AI Act, set to come into force in 2024, aims to establish a regulatory framework for AI development, including guidelines for transparency, accountability, and data protection.
Experts believe that Groq's pivot to AI inference presents both risks and opportunities for the UK. While the UK has a strong track record in AI research and development, it needs to ensure that it stays at the forefront of AI innovation, particularly in high-growth areas such as AI inference.
Dr. Emma Jones, a leading AI expert at the University of Cambridge, warns that the UK needs to invest in AI research and development to remain competitive. 'The UK's AI industry is facing significant challenges, including a shortage of skilled workers and a lack of investment in AI research,' she says.