TED演讲:我们能在打造人工智能的同时掌握控制权吗?(3)

 Now, this is often caricatured, as I have here, as a fear that armies of malicious¹ robots will attack us. 现在我们时常会看到这样一些讽刺漫画，我们总会担心受到一些不怀好意的机器人军队的攻击。

But that isn't the most likely scenario². 但这不是最可能出现的事情。

It's not that our machines will become spontaneously malevolent³. 我们的机器不会自动变得邪恶。

The concern is really that we will build machines that are so much more competent 所以，我们唯一的顾虑就是我们将会打造比我们人类更有竞争力的机器。

than we are that the slightest divergence⁴ between their goals and our own could destroy us. 而一旦我们和它们的目标不一致，我们将会被摧毁。

Just think about how we relate to ants. 想想我们与蚂蚁的关系吧。

We don't hate them. We don't go out of our way to harm them. 我们不讨厌它们，我们不会去主动去伤害它们。

In fact, sometimes we take pains not to harm them. We step over them on the sidewalk. 实际上，我们经常会尽量避免伤害蚂蚁。我们会选择从它们身边走过。

But whenever their presence seriously conflicts with one of our goals, 但只要它们的存在妨碍到了我们达成目标，

let's say when constructing a building like this one, we annihilate⁵ them without a qualm. 比如说当我们在建造这样一个建筑，我们会毫不手软地杀掉它们。

The concern is that we will one day build machines that, whether they're conscious or not, could treat us with similar disregard. 所以我们的顾虑是，终将有一天我们打造的机器，不管它们是否有意识，它们终将会以我们对待蚂蚁的方式来对待我们。

Now, I suspect this seems far-fetched to many of you. 我想很多人会说这很遥远。

I bet there are those of you who doubt that superintelligent AI is possible, much less inevitable⁶. 我打赌你们中有些人还会怀疑超级人工智能是否可能实现，认为我是在小题大做。

But then you must find something wrong with one of the following assumptions. And there are only three of them. 但是你很快会发现以下这些假设中的某一个是有问题的。下面是仅有的三种假设：

Intelligence is a matter of information processing in physical systems. 第一，智慧可以被看做物理系统中的信息处理过程。

Actually, this is a little bit more than an assumption. 事实上，这不仅仅是一个假设。

We have already built narrow intelligence into our machines, and many of these machines perform at a level of superhuman intelligence already. 我们已经在有些机器中嵌入了智能系统，这些机器中很多已经有着超越普通人的智慧了。

And we know that mere⁷ matter can give rise to what is called "general intelligence," 而且，我们也知道任何一点小事都可以引发所谓的“普遍智慧”，

an ability to think flexibly across multiple domains⁸, because our brains have managed it. Right? 这是一种可以在不同领域间灵活思考的能力，因为我们的大脑已经成功做到了这些。对吧？

I mean, there's just atoms in here, and as long as we continue to build systems of atoms that display more and more intelligent behavior, 我的意思是，大脑里其实都是原子，只要我们继续建造这些原子体系，我们就能实现越来越多的智慧行为，

we will eventually, unless we are interrupted, we will eventually build general intelligence into our machines. 我们最终将会，当然除非我们被干扰，我们最终将会给我们的机器赋予广泛意义上的智能。

1 malicious   

adj.有恶意的，心怀恶意的

参考例句：

• You ought to kick back at such malicious slander. 你应当反击这种恶毒的污蔑。
• Their talk was slightly malicious.他们的谈话有点儿心怀不轨。

2 scenario   

n.剧本，脚本；概要

参考例句：

• But the birth scenario is not completely accurate.然而分娩脚本并非完全准确的。
• This is a totally different scenario.这是完全不同的剧本。

3 malevolent   

adj.有恶意的，恶毒的

参考例句：

• Why are they so malevolent to me?他们为什么对我如此恶毒？
• We must thwart his malevolent schemes.我们决不能让他的恶毒阴谋得逞。

4 divergence   

n.分歧，岔开

参考例句：

• There is no sure cure for this transatlantic divergence.没有什么灵丹妙药可以消除大西洋两岸的分歧。
• In short,it was an age full of conflicts and divergence of values.总之，这一时期是矛盾与价值观分歧的时期。

5 annihilate   

v.使无效；毁灭；取消

参考例句：

• Archer crumpled up the yellow sheet as if the gesture could annihilate the news it contained.阿切尔把这张黄纸揉皱，好象用这个动作就会抹掉里面的消息似的。
• We should bear in mind that we have to annihilate the enemy.我们要把歼敌的重任时刻记在心上。

6 inevitable   

adj.不可避免的，必然发生的

参考例句：

• Mary was wearing her inevitable large hat.玛丽戴着她总是戴的那顶大帽子。
• The defeat had inevitable consequences for British policy.战败对英国政策不可避免地产生了影响。

7 mere   

adj.纯粹的；仅仅，只不过

参考例句：

• That is a mere repetition of what you said before.那不过是重复了你以前讲的话。
• It's a mere waste of time waiting any longer.再等下去纯粹是浪费时间。

8 domains   

n.范围( domain的名词复数 )；领域；版图；地产

参考例句：

• The theory of thermodynamics links the macroscopic and submicroscopic domains. 热力学把宏观世界同亚微观世界联系起来。 来自辞典例句
• All three flow domains are indicated by shading. 所有三个流动区域都是用阴影部分表示的。 来自辞典例句