When an attacker uses synthetic data to reverse engineer an organization’s AI model, it is...

AAISM defines model inversion attacks as those where adversaries use queries or synthetic data to reconstruct sensitive information or approximate the inner workings of a model. By exploiting outputs, attackers attempt to reverse engineer training data or model functionality. Distillation refers to compressing models, not adversarial attacks. Prompt attacks relate to manipulating language model inputs, and poisoning occurs when adversaries corrupt training data rather than infer from outputs. The scenario describes attackers using synthetic data to reveal hidden characteristics, which aligns directly with inversion attacks.