I'm pretty sure they can just prompt any convo in the background and ask "is this conversation sensitive ?" and the model can answer without this being added to the context of the convo.
One hopes the CIA/Secret service would be willing to provide the human to do the reviewing but sadly I've worked for European telco's and I know better.
I was in Shanghai recently and while casually testing one of their AI chat bots I typed "What do you think of the situation in Taiwan?".
It started discussing like a Western bot would - "it's complicated, etc. etc." and around 5s it abruptly stopped and regurgitated the same line the CCP uses "... it's an unalienable part of China etc. etc.".
After printing the line, a popup opened and my camera was activated. The app wanted me to submit my information, presumably to decide what to do with me next time I enter China.
1) All the lights and modern buildings cannot hide that China is a creepy authoritarian state underneath.
2) Given the bot started printing the Western consensus first, I bet $10 it was trained by distilling ChatGPT or Gemini.
If this were true, why didnât the chatbot immediately recognize that the word âTaiwanâ should trigger the response? Detecting the word âTaiwanâ has been possible since before most of us were born.
China has more restrictions on what you can say than the U.S. but what you are describing is not reality. Some westerner asking Deepseek about Taiwan is completely uninteresting. Just as the government do not chase people over VPN usage.
China doesnât try to hide that they are an authoritarian state. They donât need to. Most people in China are no less happy with their government than westerners are with their governments. Governments reflect culture. And as for foreigners, our view of China is far worse than it actually is, China doesnât need to hide anything, people who visit China will come away with a more positive view of the country than those who do not visit.
My wife grew up in Shanghai, and you'll have to go quite some distance to find someone more critical of the PRC and CCP than she is. And it's with good reason.
She grew up during the cultural revolution, and was largely raised by her grandmother because literally every other person in her extended family was in prison or work camp, not because of anything they had actually done wrong, but for political reasons because the whole family was blacklisted.
And that's not just the old days. Her father died as a direct result of Chinese Covid policy. During the pandemic her cousins still in the country would ask her (on Skype) "is X true?", and largely their perception of what was going on was false. She would exfiltrate encrypted news reports to them - until those started getting blocked. Her dad's estate still has affairs that need to be resolved, but we've decided not to return to China until Xi is gone, as it's just not safe. It doesn't get much airplay, but there are currently a couple of hundred Americans who are being illegally detained in China right now. It's not worth the risk.
My first trip to China was about 30 years ago, shortly after we got married. And back then, I would have said that you were right. Honestly, it felt like for the average person in their day-to-day-lives, the Chinese were less under the governmental thumb than we are. People from the countryside would bring their produce into the city to sell, or cook dumplings and buns to sell on the side of the street - stuff that in America we'd have to get permits for. It seemed that the oligarchy had an understanding with the people: let us control the big picture, and we'll look the other way for the little things. But Chinese politics is a pendulum swinging very widely. From Tienanmen Square and Tank Man, it had swung quite a bit the other way. But today, it's come back 180-degrees. Xi is really trying for a Cultural Revolution 2.0.
These impressions largely match what I hear from other Chinese immigrants - except for Party members, who tend not to want to talk about it at all. I'm afraid that you've been listening to too much propaganda.
âthere are currently a couple of hundred Americans who are being illegally detained in China right nowâ
Compared to the U.S. which currently has no foreign nationals detained illegally?
Pick any country and you will find political dissidents. The existence of angry emigrants is not evidence that a country is worse than we could ever imagine.
> After printing the line, a popup opened and my camera was activated. The app wanted me to submit my information, presumably to decide what to do with me next time I enter China.
Was this on your personal device? I'm just wondering how it activated your camera. I would love more details!
The amount of information about everything that people are giving OpenAI is astronomical, information that was previously kept closely guarded is now just freely flowing through foreign servers.
Truly a paradise for american intelligence. Would have expected that the chinese officials be briefed on not using us tech companies, but opsec is hard to teach, and even harder to always follow.
> While the US certainly isn't pure, its scale of surveillance intrusion is light compared to China
I assume that for someone to believe this, they either have to believe the U.S. has poorer surveillance capability than China, or, more likely, they consider U.S. surveillance unintrusive and Chinese surveillance intrusive.
> âThis is what Chinese modern transnational repression looks like,â Ben Nimmo, principal investigator at OpenAI, told reporters ahead of the reportâs release. âItâs not just digital. Itâs not just about trolling. Itâs industrialized. [...]
There's something poetic about OpenAI being asked to comment on mis-use of their slop generator, and their answer is composed entirely of AI slop.
> âItâs not just digital. Itâs not just about trolling. Itâs industrialized. Itâs about trying to hit critics of the CCP [Chinese Communist Party] with everything, everywhere, all at once.â
I wonder what exactly the trigger conditions are that lead to the chats of an account being human-reviewed by OpenAI.
I'm pretty sure they can just prompt any convo in the background and ask "is this conversation sensitive ?" and the model can answer without this being added to the context of the convo.
This is -the- question.
"Is this someone important enough to spy on?"
One hopes the CIA/Secret service would be willing to provide the human to do the reviewing but sadly I've worked for European telco's and I know better.
Sounds like Anthropic is fighting this exact battle, and DOD is arguing they donât want to do that lol
I was in Shanghai recently and while casually testing one of their AI chat bots I typed "What do you think of the situation in Taiwan?".
It started discussing like a Western bot would - "it's complicated, etc. etc." and around 5s it abruptly stopped and regurgitated the same line the CCP uses "... it's an unalienable part of China etc. etc.".
After printing the line, a popup opened and my camera was activated. The app wanted me to submit my information, presumably to decide what to do with me next time I enter China.
1) All the lights and modern buildings cannot hide that China is a creepy authoritarian state underneath.
2) Given the bot started printing the Western consensus first, I bet $10 it was trained by distilling ChatGPT or Gemini.
If this were true, why didnât the chatbot immediately recognize that the word âTaiwanâ should trigger the response? Detecting the word âTaiwanâ has been possible since before most of us were born.
China has more restrictions on what you can say than the U.S. but what you are describing is not reality. Some westerner asking Deepseek about Taiwan is completely uninteresting. Just as the government do not chase people over VPN usage.
China doesnât try to hide that they are an authoritarian state. They donât need to. Most people in China are no less happy with their government than westerners are with their governments. Governments reflect culture. And as for foreigners, our view of China is far worse than it actually is, China doesnât need to hide anything, people who visit China will come away with a more positive view of the country than those who do not visit.
This is manifestly false.
My wife grew up in Shanghai, and you'll have to go quite some distance to find someone more critical of the PRC and CCP than she is. And it's with good reason.
She grew up during the cultural revolution, and was largely raised by her grandmother because literally every other person in her extended family was in prison or work camp, not because of anything they had actually done wrong, but for political reasons because the whole family was blacklisted.
And that's not just the old days. Her father died as a direct result of Chinese Covid policy. During the pandemic her cousins still in the country would ask her (on Skype) "is X true?", and largely their perception of what was going on was false. She would exfiltrate encrypted news reports to them - until those started getting blocked. Her dad's estate still has affairs that need to be resolved, but we've decided not to return to China until Xi is gone, as it's just not safe. It doesn't get much airplay, but there are currently a couple of hundred Americans who are being illegally detained in China right now. It's not worth the risk.
My first trip to China was about 30 years ago, shortly after we got married. And back then, I would have said that you were right. Honestly, it felt like for the average person in their day-to-day-lives, the Chinese were less under the governmental thumb than we are. People from the countryside would bring their produce into the city to sell, or cook dumplings and buns to sell on the side of the street - stuff that in America we'd have to get permits for. It seemed that the oligarchy had an understanding with the people: let us control the big picture, and we'll look the other way for the little things. But Chinese politics is a pendulum swinging very widely. From Tienanmen Square and Tank Man, it had swung quite a bit the other way. But today, it's come back 180-degrees. Xi is really trying for a Cultural Revolution 2.0.
These impressions largely match what I hear from other Chinese immigrants - except for Party members, who tend not to want to talk about it at all. I'm afraid that you've been listening to too much propaganda.
âthere are currently a couple of hundred Americans who are being illegally detained in China right nowâ
Compared to the U.S. which currently has no foreign nationals detained illegally?
Pick any country and you will find political dissidents. The existence of angry emigrants is not evidence that a country is worse than we could ever imagine.
> After printing the line, a popup opened and my camera was activated. The app wanted me to submit my information, presumably to decide what to do with me next time I enter China.
Was this on your personal device? I'm just wondering how it activated your camera. I would love more details!
Yeah that part is either just bullshit or OP gave the bot access to his camera previously, which is just dumb.
He's lying.
Same thing happened to me, except it was a facetime call from Xi.
Pushing aside the fact that OpenAI is just a tool of the US regime.
Will OpenAI release the same for other government officials from any other states?
I can't wait to see Starmer's chats with ChatGPT.
Anyway, all of this smells like 1934, "accusing them of what we are already doing"
The amount of information about everything that people are giving OpenAI is astronomical, information that was previously kept closely guarded is now just freely flowing through foreign servers.
Truly a paradise for american intelligence. Would have expected that the chinese officials be briefed on not using us tech companies, but opsec is hard to teach, and even harder to always follow.
But the american silicon valley nerds pinky swear not to look!
How can you not trust them.
This is the report on which the CNN article is based (which it doesnât link to): https://cdn.openai.com/pdf/df438d70-e3fe-4a6c-a403-ff632def8...
Wow, our surveillance helped take down their surveillance. Yay, I guess?
"Our glorious oversight vs their barbaric surveillance"
(I kid, mostly. While the US certainly isn't pure, its scale of surveillance intrusion is light compared to China)
> While the US certainly isn't pure, its scale of surveillance intrusion is light compared to China
I assume that for someone to believe this, they either have to believe the U.S. has poorer surveillance capability than China, or, more likely, they consider U.S. surveillance unintrusive and Chinese surveillance intrusive.
Crazy to me that Chinese officials use ChatGPT to discuss sensitive operations lmao
More interesting than the fact that ChatGPT was used, was seeing all the specific examples of the types of work that this individual was doing.
I'm assuming they would not disclose such campaigns by the US government.
I can't imagine the amount of government secrets, trade secrets, business plans, personal secrets, etc that people divulge on there.
> âThis is what Chinese modern transnational repression looks like,â Ben Nimmo, principal investigator at OpenAI, told reporters ahead of the reportâs release. âItâs not just digital. Itâs not just about trolling. Itâs industrialized. [...]
There's something poetic about OpenAI being asked to comment on mis-use of their slop generator, and their answer is composed entirely of AI slop.
> âItâs not just digital. Itâs not just about trolling. Itâs industrialized. Itâs about trying to hit critics of the CCP [Chinese Communist Party] with everything, everywhere, all at once.â