Artificial intelligence can certainly get things wrong, but the deeper risk is that it agrees with us too easily.
What if staying alive depends on minimizing surprise? The Free Energy Principle suggests that feeling itself may be what that process is like from the inside.