Report Says Contractors Review Copilot Users’ Uploaded Images, Including Sensitive Requests
Summary
A 404 Media report says contractors review some Copilot users’ photos, editing requests, and generated images. Microsoft has not clarified whether users can exclude uploads from these image-rating reviews.
Key points
- Contractors are shown original photos, users’ editing requests, and two AI-generated edits, then rate the edits’ technical quality.
- The report describes sexual and potentially nonconsensual requests, including images involving children; faces in source photos are visible to reviewers.
- Contractors interviewed by 404 Media said they are not tasked with making legal or safety judgments about the content.
- Microsoft did not tell 404 Media whether users can keep uploads out of the image-rating tasks.
- Microsoft says the updated consumer Copilot app does not use prompts, responses, or uploaded file contents to train foundation models.
- Microsoft’s FAQ for an older consumer Copilot version says eligible users can opt out of training, but not certain human reviews; whether that includes image-rating tasks is unclear.
Article Details
- Event Type
- Report that contractors review Copilot users’ uploaded images, editing requests, and generated images for quality rating
- Impact
- Reviewers may see identifiable photos and disturbing or sexual content, including content involving children. The report raises privacy concerns because it is unclear whether users can exclude their uploads from these image-review tasks.
People
Ariana GrandeThe article says users had asked Copilot to create images depicting her suffering from anorexia.Shane JonesMachine learning engineer who raised concerns about bypassing guardrails in DALL-E 3.Taylor SwiftThe article says a loophole in Copilot Designer enabled creation of nonconsensual intimate deepfakes of her.
Vendors
Products
CopilotA report from 404 Media this week describes contractors reviewing Copilot users’ photos, editing requests, and the images Copilot produces.Copilot DesignerHe had previously asked the company to remove Copilot Designer, which used the tool, from public use for three months but said Microsoft had refused.DALL-E 3In early 2024, machine learning engineer Shane Jones went public with concerns over the ability to bypass guardrails in the software’s text-to-image tool DALL-E 3.