Child online safety: Industry engagement and regulation | IGF 2023 Open Forum #58

Knowledge Graph of Debate

Session report

Julie Inman Grant

The analysis covered a range of topics related to online safety and abuse. One of the main points discussed was Australia’s strong online content scheme, which has been in place for over 22 years. The scheme is primarily extraterritorial, as almost all of the illegal content it deals with is hosted overseas. This highlights Australia’s commitment to tackling online content and ensuring a safe online environment for its citizens.

Another important aspect highlighted in the analysis is the need for a more individuals-centered approach in addressing online abuse. Schemes have been put in place to address individual abuse cases, and understanding current trends in online abuse is deemed integral to applying systemic powers effectively. Taking into account the experiences and needs of individuals affected by online abuse can lead to more targeted and effective interventions.

A concerning finding from the analysis is the significant increase in cases of online child sexual exploitation and sexual extortion. It is reported that there has been a doubling of child sexual exploitation cases and a tripling of sexual extortion reports. Shockingly, one in eight analyzed URLs involves coerced and self-produced abuse through smartphones and webcams. These figures highlight the urgent need for robust measures to combat online child sexual abuse and protect vulnerable children.

The role of online platforms in preventing abuse was also discussed. Currently, online platforms are being used as weapons for abuse. However, platforms like Snap and Instagram have been provided with intelligence reports on how to prevent this abuse. The analysis suggests that online platforms should do more to proactively guard against their services being exploited for abusive purposes.

The analysis also touched upon the topic of corporate responsibility in online safety. The introduction of the basic online safety expectations tool allows the government to ask transparency questions and compel legal answers from companies. Furthermore, companies can be fined based on their truthful and complete responses. These expectations play a pivotal role in compelling companies to operate safely and protect their users.

Global collaboration and transparency were identified as crucial factors in tackling online child abuse. Initiatives like the Heaton Initiative are putting pressure on large companies, such as Apple, to do more to address child sexual abuse. Additionally, future enforcement announcements targeted at five more countries are to be made next year, indicating the ongoing commitment to global collaboration in combating online child abuse.

The analysis also highlighted the challenges faced in safeguarding children online. While the internet has become an essential tool for children’s education, communication, and exploration, it was not initially built with children in mind. Notably, there has been a notable increase in reports of cyberbullying among younger children during COVID-19 lockdowns. It is imperative to strike a balance between safeguarding children appropriately and allowing them to benefit from the internet’s use.

Regarding age verification, the analysis presented differing viewpoints. Companies were encouraged to take responsibility in verifying users’ ages and facilitating meaningful checks. However, it was suggested that age verification should not restrict children’s access to necessary and beneficial content. Trials for age verification are currently being conducted by platforms like Roblox, and Tinder and Instagram have begun implementing age verification in Australia. However, there are concerns about the effectiveness and potential restrictions on access for marginalized communities.

The effectiveness of META’s Oversight Board in reviewing content moderation decisions was called into question. In the past year, the board received around 1.3 million requests for content moderation reviews but was only able to cover 12 cases. This raises concerns about the board’s efficiency in handling the sheer volume of cases.

Lastly, the analysis emphasized the importance of multinational regulation for online platforms and the need for specialized agencies to handle investigations. The gray area of regulation poses significant challenges, requiring multi-layered investigations to effectively address abuse and ensure accountability.

In conclusion, the analysis shed light on various aspects of online safety and abuse. It highlighted Australia’s strong online content scheme, the need for individuals-centered approaches in tackling online abuse, the concerning increase in cases of online child sexual exploitation, and the role of online platforms in preventing abuse. The importance of global collaboration, corporate responsibility, and safeguarding children online was also emphasized. Critical evaluations were made regarding age verification measures, META’s Oversight Board, and the need for multinational regulation and specialized agencies. These insights provide valuable information for policymakers, platforms, and organizations to address online safety and combat abuse effectively.

Audience

The discussion revolves around striking a balance between children’s right to access information online and ensuring their safety, particularly in relation to sexuality education. It is important to provide children with accurate and scientific information while also protecting them from potentially harmful content. This highlights the need for a comprehensive and inclusive approach to online education.

There are ongoing discussions regarding the implementation of new regulations to safeguard children online. The speaker questions whether there is a balance between raising awareness and imposing obligations on service providers under these regulations. This reflects the growing recognition of the importance of protecting children from abuse, exploitation, and violence online.

In terms of ensuring child safety online, the audience argues for not only blocking but also removing harmful content. Simply blocking such content may not be sufficient, as individuals seeking it may find ways to circumvent these blocks. Therefore, the removal of harmful content becomes crucial to guarantee the safety of children.

In conclusion, the discussion emphasizes the need for a balanced approach that upholds children’s right to access accurate information while safeguarding them from harmful content. The introduction of new regulations and the emphasis on removing, not just blocking, harmful content further demonstrate the commitment towards ensuring online child safety. This signifies progress in protecting children from abuse, exploitation, and violence in the digital realm.

Noteworthy topics discussed include children’s rights, online safety, access to information, and sexuality education. Additionally, the discourse touches upon the relevance of the UN Convention on the Rights of the Child and the impact of digital regulation on children’s rights and internet safety. These aspects contribute to a comprehensive understanding of the subject matter and highlight the interconnections between various global initiatives, such as SDG 4: Quality Education, SDG 5: Gender Equality, and SDG 16: Peace, Justice, and Strong Institutions.

Tatsuya Suzuki

During the discussion, the speakers emphasised the need to enhance internet safety for children. They highlighted the importance of having a comprehensive plan in place to ensure the secure use of the internet by children. This plan involves collaborative efforts with various stakeholders, including academics, lawyers, communications companies, and school officials. These groups can work together to develop strategies and guidelines that promote responsible internet use among children.

The speakers also expressed their support for public-private initiatives aimed at addressing online child abuse and exploitation. They recognised the crucial role of the Child Welfare Agency in upholding the interests of the private sector in these efforts. Additionally, they highlighted the active collaboration between the agency and the Ministry of Education, Culture, Sports, and Tourism, as well as the involvement of Japanese UNICEF. These collaborations are important in developing effective and comprehensive approaches to combating online child abuse and exploitation.

Overall, the sentiment expressed during the discussion was positive, with a strong emphasis on implementing measures to protect children online. The speakers recognised the urgency and importance of ensuring the safety and security of children in their online activities.

Through the analysis, it is evident that this issue is aligned with Sustainable Development Goal 16.2, which aims to end abuse, exploitation, trafficking, and all forms of violence and torture against children. By addressing the challenges of internet safety and working towards its improvement, progress can be made towards achieving this goal.

In summary, the discussion highlighted the necessity of implementing initiatives to improve the safe and secure use of the internet for children. Collaboration with various stakeholders, such as academics, lawyers, communications companies, and school officials, is essential in developing a comprehensive plan. The support for public-private initiatives in tackling online child abuse and exploitation was also emphasised, acknowledging the roles of the Child Welfare Agency, Ministry of Education, Culture, Sports, and Tourism, and Japanese UNICEF. Overall, there was a positive sentiment towards the implementation of measures that protect children online, aligning with Sustainable Development Goal 16.2.

Moderator – Afrooz Kaviani Johnson

Child exploitation on the internet is an ongoing issue that has evolved over the years. It now encompasses more than just explicit materials, but also the ways in which technology enables abuse. To effectively address this issue, collaboration across sectors is crucial.

Australia’s eSafety Commissioner is at the forefront of combating online abuse. This government agency has implemented a range of regulatory tools to drive industry-wide change. The role of Australia’s eSafety Commissioner in spearheading these efforts is commendable.

The involvement of the private sector is also vital in protecting children online. Companies are increasingly being called upon to take proactive measures and be accountable for their responsibilities in ensuring online child safety. These discussions involve industry experts from various countries, including Japan’s private sector and BSR Business for Social Responsibility.

Japan is making significant strides in enhancing internet safety for young adolescents. The country’s Child Welfare Agency and multiple stakeholders, such as academics, lawyers, communications companies, school officials, and TTA organizations, are actively involved in creating a safe and secure online environment for young people. Japan’s measures in this regard have been positively received and appreciated.

Recognising the importance of private sector involvement, Japan’s Child Welfare Agency has developed the Internet Environment Management Act, which respects the individual and subjective interests of private organizations. These organizations are actively engaged in ensuring the safe and secure use of the internet by children.

Addressing online child abuse is a complex and challenging task. Mr Suzuki, a prominent speaker, highlighted the various ways in which children can fall victim to online abuse, emphasising the need for parental involvement and proper ‘netiquette’. In Ghana, collaborative regulation involving tech companies has been adopted to tackle online child abuse.

Continued learning and knowledge exchange are crucial in combating online child abuse. A recent discussion on internet literacy and online child abuse served as a fruitful exercise and a positive step in addressing the issue. Ultimately, promoting sustainable development by ensuring all learners acquire the necessary knowledge and skills is vital.

In conclusion, addressing the issue of child exploitation on the internet requires collaboration across sectors, involvement of government agencies like Australia’s eSafety Commissioner, proactive engagement of companies, efforts from countries like Japan, and continued learning. These various approaches collectively work towards protecting children online and making the digital world a safer space for young people.

Toshiyuki Tateishi

Summary:
The Japanese private sector has adapted over the past decade to address the challenges of online child sexual abuse and exploitation. Japan has a constitutional law that protects the secrecy of communication, preventing the blocking of certain websites. They have also implemented mechanisms, such as the Jeopardy system, to block access to illegal sites. If the abusive site is located in Japan, it is deleted by the ISP and investigated by the police. If the site is overseas and found to be sexually abusive, it is promptly blocked. Japan’s approach to internet safety has been commended for its low level of government interference with digital freedoms. They emphasize balancing freedom of communication, security, and innovation online. Communication is seen as crucial before taking down any content, even engaging with parties located overseas. Overall, Japan’s comprehensive approach demonstrates its commitment to creating a safe online environment and addressing online child abuse and exploitation.

Edit:
The private sector in Japan has proactively responded to the emerging challenges of online child sexual abuse and exploitation in recent years. Japan has enacted a constitutional law that safeguards the confidentiality of communication, thereby prohibiting the blocking of certain websites. To combat online child abuse, Japan has established mechanisms like the Jeopardy system, which enables DNS servers to block access to illegal sites. If an abusive site is discovered within Japan, the Internet Service Provider (ISP) will delete it and involve the police for further investigation. In the case of overseas sites, a thorough examination is conducted, and if found to contain sexually abusive content, it is promptly blocked. Japan’s efforts to combat online child abuse have been recognized by a 2016 UN report for preserving digital freedoms with minimal government interference. They place a particular emphasis on striking a balance between freedom of communication, security, and innovation in the online realm. Additionally, before taking down any content, Japan believes in attempting communication with the relevant parties, even if they are located overseas. This approach underscores the importance of dialogue and potential collaboration with foreign entities to effectively address online safety concerns. Overall, Japan’s comprehensive strategy exemplifies its unwavering dedication to promoting a secure online environment and combating online child abuse and exploitation.

Dunstan Allison-Hope

Human rights due diligence plays a vital role in upholding child rights and combating the alarming issue of online child sexual exploitation and abuse. Business for Social Responsibility (BSR) emphasises that incorporating human rights due diligence is essential for companies to demonstrate their commitment to the well-being of children. BSR has conducted over 100 different human rights assessments with technology companies, highlighting the significance of this approach.

A comprehensive human rights assessment involves a systematic review of impacts across all international human rights instruments, focusing on safeguarding rights such as bodily security, freedom of expression, privacy, education, access to culture, and non-discrimination. It is crucial to adopt a human rights-based approach, which includes considering the rights of those most vulnerable, particularly children who are at a greater risk.

The European Union Corporate Sustainability Due Diligence Directive now mandates that all companies operating in Europe must undertake human rights due diligence. As part of this process, companies must evaluate the risks to child rights and integrate this consideration into their broader human rights due diligence frameworks. By explicitly including child rights in their assessments, companies can ensure that they are actively addressing and preventing any potential violations.

However, it is important to maintain a global perspective in human rights due diligence while complying with regional laws and regulations. Numerous regulations from the European Union and the UK require human rights due diligence. However, there is a concern that so much time and attention going towards the European Union and the United Kingdom takes time away from places where human rights risks may be more severe. Therefore, while adhering to regional requirements, companies should also consider broader global approaches to effectively address human rights issues worldwide.

A holistic human rights-based approach seeks to achieve a balance in addressing different human rights, with a specific focus on child rights. Human rights assessments typically identify child sexual exploitation and abuse as the most severe risks. To ensure the fulfilment of all rights, a comprehensive assessment must consider the relationship between different human rights, with considerations given to tensions and the fulfilment of one right enabling the fulfilment of other rights.

Another crucial aspect of human rights due diligence is the application of human rights principles to decisions about when and how to restrict access to content. Cases before the meta-oversight board have shown that having the time to analyse a condition can provide insights and ways to unpack the relation between rights. Applying human rights principles like legitimacy, necessity, proportionality, and non-discrimination to decisions about when and how to restrict access to content helps ensure a balanced approach.

It is also important to provide space to consider dilemmas, uncertainties, and make recommendations in cases relating to human rights, particularly child rights. Highlighted is the use of space available for the meta-oversight board to make decisions and the idea for similar processes to take place concerning child rights is welcomed. This helps ensure that informed decisions, considerations of different perspectives, and recommendations can be made.

In conclusion, human rights due diligence is vital to respect and safeguard child rights and combat online child sexual exploitation and abuse. By integrating child rights into their broader human rights due diligence, companies can demonstrate their commitment to the well-being of children. While complying with regional laws, it is crucial to adopt a global approach to effectively address human rights risks. A holistic human rights-based approach considers the interrelationships between different rights, while the application of human rights principles guides decisions about content access. Providing space for deliberation and recommendations in cases involving child rights is fundamental to making informed decisions and ensuring the protection of children’s rights.

Albert Antwi-Boasiako

The approach adopted by Ghana in addressing online child protection is one of collaborative regulation, with the objective of achieving industry compliance. In line with this, Section 87 of Ghana’s Cyber Safety Act has been established to enforce industry responsibility in safeguarding children online. The act provides provisions that compel industry players to take action to protect children from online threats.

Furthermore, Ghana’s strategy involves active engagement with industry players, such as the telecommunications chamber, to foster mutual understanding and collaboratively develop industry obligations and commitments. This collaborative approach highlights the importance of involving industry stakeholders in shaping regulations and policies, rather than relying solely on self-regulation.

The evidence supporting Ghana’s collaborative regulation approach includes the passing of a law that includes mechanisms for content blocking, takedown, and filtering to protect children online. These measures demonstrate the government’s commitment to ensuring the safety of children in the digital space.

The argument put forth is that self-regulation alone cannot effectively keep children safe online, as it may not provide sufficient guidelines and accountability. On the other hand, excessive regulation can stifle innovation and hinder the development of new technologies and services. Ghana’s approach strikes a balance by fostering collaboration between the government and industry players, promoting understanding, and establishing industry obligations without impeding innovation.

In conclusion, Ghana’s collaborative approach to online child protection aims to ensure industry compliance while striking a balance between regulation and innovation. By actively engaging with industry stakeholders, Ghana seeks to develop effective measures that safeguard children online without stifling technological advancement. This approach acknowledges the limitations of self-regulation and excessive regulation, thus presenting a more holistic and effective approach to online child protection.

Speakers