Researchers develop a method to improve reward models using LLMs for synthetic critiques

Researchers from Cohere and the University of Oxford have introduced an innovative method to enhance reward models (RMs) in reinforcement learning from human feedback (RLHF) by leveraging large language models (LLMs) for synthetic critiques. The novel approach aims to reduce the extensive time and cost associated with human annotation, which is traditionally required for training RMs to predict scores based on human preferences.

In their paper, ‘Improving Reward Models with Synthetic Critiques’, the researchers detailed how LLMs could generate critiques that evaluate the relationship between prompts and generated outputs, predicting scalar rewards. These synthetic critiques improved the performance of reward models on various benchmarks by providing additional feedback on aspects like instruction following, correctness, and style, leading to better assessment and scoring of language models.

The study highlighted that high-quality synthetic critiques significantly increased data efficiency, with one enhanced preference pair as valuable as forty non-enhanced pairs. The approach makes the training process more cost-effective and has the potential to match or surpass traditional reward models, as demonstrated by GPT-4.0’s performance in certain benchmarks.

As the field continues to explore alternatives to RLHF, including reinforcement learning from AI feedback (RLAIF), this research indicates a promising shift towards AI-based critiquing, potentially transforming how major AI players such as Google, OpenAI, and Meta align their large language models.

Reliance’s Jio platforms clears major hurdle in bid to launch satellite internet in India

Reliance Industries’ Jio Platforms, a major player in the Indian telecommunications market, has recently cleared a significant regulatory hurdle in its ambitious plan to launch satellite internet services in India. That development marks a pivotal step forward in Jio’s mission to expand its digital footprint and offer high-speed internet across the country’s vast and diverse landscape. The approval comes from the Indian National Space Promotion and Authorization Center (IN-SPACe), which is responsible for regulating and promoting private sector participation in the country’s space sector. The nod of approval is crucial for Jio Platforms as it paves the way for the deployment of low-earth orbit (LEO) satellites to provide internet services.

Jio’s satellite internet project aims to deliver high-speed broadband connectivity to remote and rural areas, where traditional fiber-optic networks are challenging to implement. That initiative aligns with the Indian government’s vision of a ‘Digital India’ aimed at bridging the digital divide and ensuring that every citizen has access to the internet. In its endeavor to roll out satellite internet, Jio Platforms is collaborating with SES, a Luxembourg-based satellite telecommunications company. The partnership is expected to leverage SES’s expertise in satellite technology and Jio’s robust terrestrial infrastructure, creating a seamless internet experience for users.

The technology underpinning this initiative involves the use of LEO satellites, which orbit closer to the Earth compared to traditional geostationary satellites. That proximity results in lower latency and faster internet speeds, making it a viable solution for real-time applications such as video conferencing, online gaming, and streaming services. The market in India presents a massive opportunity for satellite internet providers, given its large population and the significant number of underserved regions. According to industry estimates, India has over 700 million internet users, yet millions still lack reliable internet access, particularly in rural and remote areas.

Jio Platforms’ entry into the satellite internet space will position it against other global players like Elon Musk’s SpaceX and its Starlink project, as well as Amazon’s Project Kuiper. Two other companies, Inmarsat and Eutelsat‘s Bharti Enterprises-backed OneWeb, have also received approval to operate satellites over India, with OneWeb having secured all its necessary permissions late last year. IN-SPACe Chairman Pawan Goenka also noted that the agency would soon authorise private companies to operate ground stations, enabling satellite operators to download data as they pass over India. This year, India opened the gates for foreign direct investment in the sector, allowing outside companies to invest in the manufacture of components and systems or subsystems for satellites up to 100% without approval.

Why does it matter?

The Indian satellite broadband service market is expected to grow 36% annually over the next five years and reach $1.9 billion by 2030, according to consultancy Deloitte. That indicates substantial growth potential and a transformative impact on the country’s internet accessibility.

Iran allocates funds to expand state-controlled internet infrastructure

The Raisi administration in Iran has allocated millions of dollars towards bolstering the country’s internet infrastructure, focusing on tightening control over information flow and reducing the influence of external media.

This decision, part of a broader financial strategy for the Ministry of Communications and Information Technology, reflects a 25% increase from the previous year’s budget, totalling over IRR 195,830 billion (approximately $300 million). Additionally, over IRR 150,000 billion (over $220 million) in miscellaneous credits have been earmarked to expand the national information network.

The Ministry of Communications and Information Technology’s efforts aim to reduce dependency on the global internet, leading to a more isolated and state-controlled national information network.

Why does it matter?

Popular social media platforms like Instagram and Facebook are blocked in Iran, and the government appears to be tightening internet control. Cloudflare has observed a significant decrease in internet traffic from Iran over the past two years, suggesting a trend of increased control and isolation. However, widespread internet disruptions have sparked discontent, leading the Tehran Chamber of Commerce to call for policy reassessment, citing economic concerns.

Internet shutdowns spike in Q1 2024

In the first quarter of 2024, Pulse has documented 22 deliberate internet shutdowns across 12 countries, with some ongoing since 2023. This figure matches the peak seen in 2021 during Myanmar‘s military coup, highlighting a concerning trend. India has been the most affected, with nine shutdowns, followed by Ethiopia and Senegal, each experiencing two incidents. Over half of these shutdowns have been localised, impacting specific regions within countries including Chad, Comoros, Cuba, Iran, Pakistan, Palestinian Territory and Russia.

Among the recorded events, nine led to nationwide disruptions lasting from hours to months, affecting approximately 297 million internet users and resulting in over 910 days of downtime. These shutdowns have inflicted significant economic losses, amounting to USD 565.4 million in GDP, as reported by Pulse. Such disruptions hinder societal progress, hamper economies, and undermine the stability of the global internet infrastructure.

Why does it matter?

Championing an open and easily accessible internet, advocates stress the significance of prioritising policies that ensure uninterrupted connectivity. Governments and policymakers globally are encouraged to endorse efforts to protect the internet, acknowledging its pivotal role in nurturing economic development and providing opportunities for individuals to exercise fundamental human rights in the digital era.

Vietnam approves ‘IPv6 for Gov 2024’ project to transition state services to IPv6

The Ministry of Information and Communications in Vietnam has recently approved the ‘IPv6 For Gov 2024’ project, which aims to transition all online state services to Internet Protocol version 6 (IPv6).

By the end of this year, Vietnam aims to have 65-80 percent of internet activities using IPv6, positioning the state among the top 8 nations worldwide in terms of protocol adoption. The project aims to convert 90-100 percent of formal e-Portals and public service portals of state ministries, agencies, and local authorities. This transition will facilitate more efficient and secure communication and interaction between citizens and the government.

According to statistics from the Ministry of Information and Communications, Vietnam has made significant progress in adoption. As of December 2023, IPv6 usage in Vietnam had reached an impressive 59 percent, placing the country in second position among ASEAN nations and ninth worldwide. Furthermore, all critical national Internet infrastructure in Vietnam already operates on IPv6, demonstrating the country’s commitment. By the end of the previous year, 76.48 million broadband internet subscribers, whether fixed or mobile, were already using this technology.

Internet Protocol version 6, offers a solution to the impending shortage of addresses with its nearly limitless address space. It enables the seamless integration of these technologies into the digital ecosystem.

ICANN launches project to look at what drives malicious domain name registrations

The Internet Corporation for Assigned Names and Numbers (ICANN) has launched a project to explore the practices and choices of malicious actors when they decide to use the domain names of certain registrars over others. The project, called Inferential Analysis of Maliciously Registered Domains (INFERMAL), will systematically analyse the preferences of cyberattackers and possible measures to mitigate malicious activities across top-level domains (TLDs). It is funded as part of ICANN’s Domain Name System (DNS) Security Threat Mitigation Program, which aims to reduce the prevalence of DNS security threats across the Internet.

The team leading the project intends to collect and analyse a comprehensive list of domain name registration policies pertinent to would-be attackers, and then use statistical modelling to identify the registration factors preferred by attackers. It is expected that the findings of the project could help registrars and registries identify relevant DNS anti-abuse practices, strengthen the self-regulation of the overall domain name industry, and reduce the costs associated with domain regulations. The project would also help increase the security levels of domain names and, thus, the trust of end-users.

ICANN moves closer to launching a new gTLD round

A little over 10 years after the New gTLD Program which saw the delegation of over 1,000 new generic top-level domains, the Internet Corporation for Assigned Names and Numbers (ICANN) is now moving closer to launching a new gTLD round. At the ICANN76 Community Forum in Mexico, the ICANN Board adopted a series of recommendations made in the context of what within the ICANN community is known as the New gTLD Subsequent Procedures Policy Development Process. The approval of these recommendations (with some more requiring further discussions) marks ‘the start of the implementation process for the next round of new gTLDs’.

The Board also directed ICANN to deliver a comprehensive implementation plan, including a work plan, information for the infrastructure design, timelines, and anticipated resource requirements to achieve the necessary work to open the next round of gTLDs no later than 1 August 2023. The organisation can spend up to US$9 million to fund the implementation work through 31 October 2023.

Another Board decision was to direct ICANN to promote the New gTLD Program to prospective applicants, particularly those in underserved and underrepresented regions.

IANA stewardship transition

The IANA stewardship transition process, which spanned over two years, concludes with the expiration of the IANA functions contract between ICANN and the US government, and the transition of the IANA functions stewardship to the global internet community. The process started in March 2014, when the US government announced its intention to delegate its oversight role to a global multistakeholder community. Starting October 2016, the IANA functions are performed by the Public Technical Identifiers (PTI), an affiliate of ICANN.

Decision to organise WSIS

The International Telecommunication Union (ITU) Plenipotentiary Conference held in November 1998 in Minneapolis puts the basis of the World Summit on the Information Society (WSIS). Adopted at the conference, Resolution 73:
– Instructs the ITU Secretary-General ‘to place the question of holding a world summit on the information society on the agenda of the United Nations Administrative Committee on Coordination;
– Instructs the ITU Council to ‘consider and decide on the Union’s contribution to the holding of a world summit on the information society’.