TED演讲:如何赋予AI力量而不是被它压倒(6)

One is that we should avoid an arms race and lethal¹ autonomous² weapons.

第一，我们需要避免军备竞赛，以及致命的自动化武器出现。

The idea here is that any science can be used for new ways of helping³ people or new ways of harming people.

其中的想法是，任何科学都可以用新的方式来帮助人们，同样也可以以新的方式对我们造成伤害。

For example, biology and chemistry are much more likely to be used for new medicines or new cures than for new ways of killing⁴ people,

例如，生物和化学更可能被用来制造新的医药用品，而非带来新的杀人方法，

because biologists and chemists pushed hard -- and successfully -- for bans on biological and chemical weapons.

因为生物学家和化学家很努力，也很成功地，在推动禁止生化武器的出现。

And in the same spirit, most AI researchers want to stigmatize⁵ and ban lethal autonomous weapons.

基于同样的精神，大部分的人工智能研究者也在试图指责和禁止致命的自动化武器。

Another Asilomar AI principle is that we should mitigate⁶ AI-fueled income inequality.

另一条阿西洛玛人工智能会议的原则是，我们应该要减轻由人工智能引起的收入不平等。

I think that if we can grow the economic pie dramatically with AI

我认为，我们能够大幅度利用人工智能发展出一块经济蛋糕，

and we still can't figure out how to divide this pie so that everyone is better off, then shame on us.

但却没能相处如何来分配它才能让所有人受益，那可太丢人了。

Alright, now raise your hand if your computer has ever crashed.

那么问一个问题，如果你的电脑有死机过的，请举手。

Wow, that's a lot of hands. Well, then you'll appreciate this principle that we should invest much more in AI safety research

哇，好多人举手。那么你们就会感谢这条准则，我们应该要投入更多以确保对人工智能安全性的研究，

because as we put AI in charge of even more decisions and infrastructure⁷,

因为我们让人工智能在主导更多决策以及基础设施时，

we need to figure out how to transform today's buggy and hackable computers into robust⁸ AI systems that we can really trust,

我们要了解如何将会出现程序错误以及有漏洞的电脑，转化为可靠的人工智能，

because otherwise, all this awesome⁹ new technology can malfunction¹⁰ and harm us, or get hacked¹¹ and be turned against us.

否则的话，这些了不起的新技术就会出现故障，反而伤害到我们，或被黑入以后转而对抗我们。

And this AI safety work has to include work on AI value alignment¹²,

这项人工智能安全性的工作必须包含对人工智能价值观的校准，

because the real threat from AGI isn't malice¹³, like in silly Hollywood movies, but competence¹⁴

因为AGI会带来的威胁通常并非出于恶意，就像是愚蠢的好莱坞电影中表现的那样，而是源于能力，

AGI accomplishing goals that just aren't aligned¹⁵ with ours.

AGI想完成的目标与我们的目标背道而驰。

For example, when we humans drove the West African black rhino¹⁶ extinct,

例如，当我们人类促使了西非的黑犀牛灭绝时，

we didn't do it because we were a bunch of evil rhinoceros¹⁷ haters, did we?

并不是因为我们是邪恶且痛恨犀牛的家伙，对吧？

We did it because we were smarter than them and our goals weren't aligned with theirs.

我们能够做到只是因为我们比它们聪明，而我们的目标和它们的目标相违背。

But AGI is by definition smarter than us,

但是AGI在定义上就比我们聪明，

so to make sure that we don't put ourselves in the position of those rhinos¹⁸ if we create AGI,

所以必须确保我们别让自己落到了黑犀牛的境遇，如果我们发明AGI，

we need to figure out how to make machines understand our goals, adopt our goals and retain our goals.

首先就要解决如何让机器明白我们的目标，选择采用我们的目标，并一直跟随我们的目标。

1 lethal   

adj.致死的；毁灭性的

参考例句：

• A hammer can be a lethal weapon.铁锤可以是致命的武器。
• She took a lethal amount of poison and died.她服了致命剂量的毒药死了。

2 autonomous   

adj.自治的；独立的

参考例句：

• They proudly declared themselves part of a new autonomous province.他们自豪地宣布成为新自治省的一部分。
• This is a matter that comes within the jurisdiction of the autonomous region.这件事是属于自治区权限以内的事务。

3 helping   

n.食物的一份&adj.帮助人的，辅助的

参考例句：

• The poor children regularly pony up for a second helping of my hamburger. 那些可怜的孩子们总是要求我把我的汉堡包再给他们一份。
• By doing this, they may at times be helping to restore competition. 这样一来, 他在某些时候,有助于竞争的加强。

4 killing   

n.巨额利润；突然赚大钱，发大财

参考例句：

• Investors are set to make a killing from the sell-off.投资者准备清仓以便大赚一笔。
• Last week my brother made a killing on Wall Street.上个周我兄弟在华尔街赚了一大笔。

5 stigmatize   

v.污蔑，玷污

参考例句：

• Children in single-parent families must not be stigmatized.单亲家庭的孩子们不应该受到歧视。
• They are often stigmatized by the rest of society as lazy and dirty.他们经常被社会中的其他人污蔑为懒惰、肮脏。

6 mitigate   

vt.（使）减轻，（使）缓和

参考例句：

• The government is trying to mitigate the effects of inflation.政府正试图缓和通货膨胀的影响。
• Governments should endeavour to mitigate distress.政府应努力缓解贫困问题。

7 infrastructure   

n.下部构造，下部组织，基础结构，基础设施

参考例句：

• We should step up the development of infrastructure for research.加强科学基础设施建设。
• We should strengthen cultural infrastructure and boost various types of popular culture.加强文化基础设施建设，发展各类群众文化。

8 robust   

adj.强壮的，强健的，粗野的，需要体力的，浓的

参考例句：

• She is too tall and robust.她个子太高，身体太壮。
• China wants to keep growth robust to reduce poverty and avoid job losses,AP commented.美联社评论道，中国希望保持经济强势增长，以减少贫困和失业状况。

9 awesome   

adj.令人惊叹的，难得吓人的，很好的

参考例句：

• The church in Ireland has always exercised an awesome power.爱尔兰的教堂一直掌握着令人敬畏的权力。
• That new white convertible is totally awesome.那辆新的白色折篷汽车简直棒极了.

10 malfunction   

vi.发生功能故障，发生故障，显示机能失常

参考例句：

• There must have been a computer malfunction.一定是出了电脑故障。
• Results have been delayed owing to a malfunction in the computer.由于电脑发生故障，计算结果推迟了。

11 hacked   

生气

参考例句：

• I hacked the dead branches off. 我把枯树枝砍掉了。
• I'm really hacked off. 我真是很恼火。

12 alignment   

n.队列；结盟，联合

参考例句：

• The church should have no political alignment.教会不应与政治结盟。
• Britain formed a close alignment with Egypt in the last century.英国在上个世纪与埃及结成了紧密的联盟。

13 malice   

n.恶意，怨恨，蓄意；[律]预谋

参考例句：

• I detected a suggestion of malice in his remarks.我觉察出他说的话略带恶意。
• There was a strong current of malice in many of his portraits.他的许多肖像画中都透着一股强烈的怨恨。

14 competence   

n.能力，胜任，称职

参考例句：

• This mess is a poor reflection on his competence.这种混乱情况说明他难当此任。
• These are matters within the competence of the court.这些是法院权限以内的事。

15 aligned   

adj.对齐的，均衡的

参考例句：

• Make sure the shelf is aligned with the top of the cupboard.务必使搁架与橱柜顶端对齐。

16 rhino   

n.犀牛，钱, 现金

参考例句：

• The rhino charged headlong towards us.犀牛急速地向我们冲来。
• They have driven the rhino to the edge of extinction.他们已经令犀牛濒临灭绝。

17 rhinoceros   

n.犀牛

参考例句：

• The rhinoceros has one horn on its nose.犀牛鼻子上有一个角。
• The body of the rhinoceros likes a cattle and the head likes a triangle.犀牛的形体像牛，头呈三角形。

18 rhinos   

n.犀牛（rhino的复数形式）

参考例句：

• There are many reports of people taming and even training Indian rhinos. 有许多关于人们驯养甚至训练印度犀牛的记载。 来自辞典例句
• The rhinos had fed during the night in the rice fields of these villagers. 犀牛夜里在这些村民的庄稼地里也已吃饱了。 来自辞典例句