Be wary of artificial intelligence

Cybersecurity risks

! ! !

Information Office of University of Shanghai for Science and Technology

Artificial intelligence (AI) is a technology that simulates human intelligence to perform various tasks through learning, reasoning, and self-correction. Generative artificial intelligence technology refers to models and related technologies that have the ability to generate text, pictures, audio, video and other content. It mainly uses machine learning models to understand and create new content through learning from large amounts of data.

Generative artificial intelligence technology has broad application prospects in various industries and fields. It not only affects human life and production methods, but also provides new tools and perspectives for the innovation and development of various industries. However, it also lurks a series of network security risk issues.

(1) Using artificial intelligence technology to commit fraud

Scammers use AI to change faces and sound like voices. Pretending to be a relative or friend makes a video call, and after gaining trust, they then falsely claim to be in urgent need of cash flow, etc. to commit fraud.

(2) Use artificial intelligence technology to fabricate rumors

In order to gain traffic and gain profits, illegal perpetrators often use AI software to input keywords to generate rumor articles and publish them to the public, attracting a lot of attention on the Internet and causing negative social impact.

(3) AI face-changing live broadcast to deliver goods

There are live broadcast rooms that use AI face-changing technology to "realize" celebrity endorsements to increase traffic and sales. But it also infringes on other people's rights of portrait, reputation and other rights.

In order to promote the healthy development and standardized application of generative artificial intelligence, safeguard national security and social public interests, and protect the legitimate rights and interests of citizens, legal persons and other organizations, the State Cyberspace Administration of China has joined forces with the National Development and Reform Commission, the Ministry of Education, the Ministry of Science and Technology, the Ministry of Industry and Information Technology, the Ministry of Public Security and the State Administration of Radio, Film and Television. The department issued the "Interim Measures for the Management of Generative Artificial Intelligence Services", which will be effective from August 15, 2023. It aims to promote the healthy development and standardized application of generative artificial intelligence, safeguard national security and social public interests, and protect the legitimate rights and interests of citizens, legal persons and other organizations. This approach highlights the governance of artificial intelligence with Chinese characteristics and contributes Chinese wisdom to the world’s artificial intelligence governance.

Service hotline