• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

"Godfather of AI" Geoffrey Hinton Departs Google, Voices Concern Over Dangers of AI

Joined
May 30, 2015
Messages
1,943 (0.56/day)
Location
Seattle, WA
Geoffrey Hinton, British-Canadian psychologist, computer scientist, and 2018 Turing Award winner in deep learning, has departed the Google Brain team after a decade-long tenure. His research on AI and neural networks dating back to the 1980s has helped shape the current landscape of deep learning, neural processing, and artificial intelligence algorithms with direct and indirect contributions over the years. 2012's AlexNet, designed and developed in collaboration with his students Alex Krizhevsky and Ilya Sutskever, formed the modern backbone of computer vision and AI image recognition used today in Generative AI. Hinton joined Google when the company won the bid for the tiny startup he and his two students formed in the months following the reveal of AlexNet. Ilya Sutskever left their cohort at Google in 2015 to become co-founder and Chief Scientist of OpenAI; creators of ChatGPT and one of Google's most prominent competitors.

In an interview with the New York Times Hinton says that he quit his position at Google so that he may speak freely about the risks of AI, and that a part of him regrets his life's work in the field. He said that during his time there Google has acted as a "proper steward" of AI development, and was careful about releasing anything that might be harmful. His viewpoint on the industry shifted within the last year as Microsoft's Bing Chat took shots at Google's core business, the web browser, leading to Google being more reactionary than deliberate in response with Bard. The concern arises that as these companies battle it out for AI supremacy they won't take proper precautions against bad-faith actors using the technologies to flood the internet with false photos, text, and even videos. That the average person would no longer be able to tell what was real, and what was manufactured by AI prompt.




Hinton believes that the latest systems are starting to encroach on or even eclipse Human capabilities, telling the BBC that, "Right now, what we're seeing is things like GPT-4 eclipses a person in the amount of general knowledge it has and it eclipses them by a long way. In terms of reasoning, it's not as good, but it does already do simple reasoning. And given the rate of progress, we expect things to get better quite fast. So we need to worry about that. Right now, they're not more intelligent than us, as far as I can tell. But I think they soon may be." Hinton thinks that as the systems improve, newer generations of AI could become more dangerous. These new generations may exhibit better learning capabilities from the larger data sets they use, which could lead to the AI generating and running its own code or setting its own goals. "The idea that this stuff could actually get smarter than people—a few people believed that, but most people thought it was way off. And I thought it was way off. I thought it was 30 to 50 years or even longer away. Obviously, I no longer think that."

Dr. Hinton admits that at 75 years old it's time to retire, and makes it very clear that he in no way quit so that he could criticize Google or the team he worked with for over 10 years. He tells the BBC that he has, "some good things" to say about Google and their approach to AI, but that those comments would be more credible if he did not work for them.

View at TechPowerUp Main Site | Source
 
Joined
Sep 28, 2005
Messages
3,361 (0.48/day)
Location
Canada
System Name PCGR
Processor 12400f
Motherboard Asus ROG STRIX B660-I
Cooling Stock Intel Cooler
Memory 2x16GB DDR5 5600 Corsair
Video Card(s) Dell RTX 3080
Storage 1x 512GB Mmoment PCIe 3 NVME 1x 2TB Corsair S70
Display(s) LG 32" 1440p
Case Phanteks Evolve itx
Audio Device(s) Onboard
Power Supply 750W Cooler Master sfx
Software Windows 11
So 40 years ago he had no concerns? Just recently huh…

What was that Jerassic Park quote about scientists?
"when you gotta go, you gotta go"
 
Joined
Mar 16, 2017
Messages
2,161 (0.76/day)
Location
Tanagra
System Name Budget Box
Processor Xeon E5-2667v2
Motherboard ASUS P9X79 Pro
Cooling Some cheap tower cooler, I dunno
Memory 32GB 1866-DDR3 ECC
Video Card(s) XFX RX 5600XT
Storage WD NVME 1GB
Display(s) ASUS Pro Art 27"
Case Antec P7 Neo
"The idea that this stuff could actually get smarter than people—a few people believed that, but most people thought it was way off. And I thought it was way off. I thought it was 30 to 50 years or even longer away. Obviously, I no longer think that."
Well, we’re raising the bar on AI, while lowering the bar on our own education and development, so maybe that’s part of the reason they got the timeline wrong. And every big corp is chasing AI to make and/or save a buck. The culmination of laziness and greed.
 
Joined
Jan 14, 2019
Messages
12,577 (5.80/day)
Location
Midlands, UK
System Name Nebulon B
Processor AMD Ryzen 7 7800X3D
Motherboard MSi PRO B650M-A WiFi
Cooling be quiet! Dark Rock 4
Memory 2x 24 GB Corsair Vengeance DDR5-4800
Video Card(s) AMD Radeon RX 6750 XT 12 GB
Storage 2 TB Corsair MP600 GS, 2 TB Corsair MP600 R2
Display(s) Dell S3422DWG, 7" Waveshare touchscreen
Case Kolink Citadel Mesh black
Audio Device(s) Logitech Z333 2.1 speakers, AKG Y50 headphones
Power Supply Seasonic Prime GX-750
Mouse Logitech MX Master 2S
Keyboard Logitech G413 SE
Software Bazzite (Fedora Linux) KDE
How long until there's a ban on AI in every civilised country?
 
Joined
Jul 19, 2006
Messages
43,609 (6.48/day)
Processor AMD Ryzen 7 7800X3D
Motherboard ASUS TUF x670e-Plus Wifi
Cooling EK AIO 360. Phantek T30 fans.
Memory 32GB G.Skill 6000Mhz
Video Card(s) Asus RTX 4090
Storage WD/Samsung m.2's
Display(s) LG C2 Evo OLED 42"
Case Lian Li PC 011 Dynamic Evo
Audio Device(s) Topping E70 DAC, SMSL SP200 Amp, Adam Audio T5V's, Hifiman Sundara's.
Power Supply FSP Hydro Ti PRO 1000W
Mouse Razer Basilisk V3 Pro
Keyboard Epomaker 84 key
Software Windows 11 Pro
If countries don't start setting better standards for communications, television and the internet this could be society collapsing stuff.
 
Joined
Sep 15, 2011
Messages
6,762 (1.39/day)
Processor Intel® Core™ i7-13700K
Motherboard Gigabyte Z790 Aorus Elite AX
Cooling Noctua NH-D15
Memory 32GB(2x16) DDR5@6600MHz G-Skill Trident Z5
Video Card(s) ZOTAC GAMING GeForce RTX 3080 AMP Holo
Storage 2TB SK Platinum P41 SSD + 4TB SanDisk Ultra SSD + 500GB Samsung 840 EVO SSD
Display(s) Acer Predator X34 3440x1440@100Hz G-Sync
Case NZXT PHANTOM410-BK
Audio Device(s) Creative X-Fi Titanium PCIe
Power Supply Corsair 850W
Mouse Logitech Hero G502 SE
Software Windows 11 Pro - 64bit
Benchmark Scores 30FPS in NFS:Rivals
I think all the AI doomsayers are overreacting and exaggerating too much. AI is not dangerous, it just uses the free public available info online.
What is dangerous is the tools such as deepfake, voiceovers, etc, that can be used in malicious purposes, so that can be regulated.
For me, the tools such as BARD, ChatGPT and BingChat are tremendous helpful in my work, helping me complete tasks in 1H, that usually were taking 1 day or more to achieve.
It all depends how you use those tools.
 
Joined
May 30, 2015
Messages
1,943 (0.56/day)
Location
Seattle, WA
it just uses the free public available info online.

Free public info includes how to write and implement malware, break encryption, social engineer personal data, and more. What isn't available it can infer, what it can't infer it can solve. The point Dr. Hinton is making is that continued development at breakneck pace for the sake of 'being the best' is going to lead to a point where the algorithms developed are better than our own cognition with certain tasks. Who will be faster: a machine writing and implementing malicious code or teams of developers combating it? Hope that you never have to find out.

What began as acedemia has become an arms race with no oversight.
 
Joined
Sep 15, 2011
Messages
6,762 (1.39/day)
Processor Intel® Core™ i7-13700K
Motherboard Gigabyte Z790 Aorus Elite AX
Cooling Noctua NH-D15
Memory 32GB(2x16) DDR5@6600MHz G-Skill Trident Z5
Video Card(s) ZOTAC GAMING GeForce RTX 3080 AMP Holo
Storage 2TB SK Platinum P41 SSD + 4TB SanDisk Ultra SSD + 500GB Samsung 840 EVO SSD
Display(s) Acer Predator X34 3440x1440@100Hz G-Sync
Case NZXT PHANTOM410-BK
Audio Device(s) Creative X-Fi Titanium PCIe
Power Supply Corsair 850W
Mouse Logitech Hero G502 SE
Software Windows 11 Pro - 64bit
Benchmark Scores 30FPS in NFS:Rivals
Who will be faster: a machine writing and implementing malicious code or teams of developers combating it?
This is a 2 way thing. Use the AI to create better, stronger Antivirus/Antimalware software. See?
Modern problems require modern solutions. ;)
 

64K

Joined
Mar 13, 2014
Messages
6,773 (1.72/day)
Processor i7 7700k
Motherboard MSI Z270 SLI Plus
Cooling CM Hyper 212 EVO
Memory 2 x 8 GB Corsair Vengeance
Video Card(s) Temporary MSI RTX 4070 Super
Storage Samsung 850 EVO 250 GB and WD Black 4TB
Display(s) Temporary Viewsonic 4K 60 Hz
Case Corsair Obsidian 750D Airflow Edition
Audio Device(s) Onboard
Power Supply EVGA SuperNova 850 W Gold
Mouse Logitech G502
Keyboard Logitech G105
Software Windows 10
I don't profess to know anything much at all about AI research but I did find this article interesting:

 
Joined
Jun 6, 2021
Messages
708 (0.55/day)
System Name Red Devil
Processor AMD 5950x - Vermeer - B0
Motherboard Gigabyte X570 AORUS MASTER
Cooling NZXT Kraken Z73 360mm; 14 x Corsair QL 120mm RGB Case Fans
Memory G.SKill Trident Z Neo 32GB Kit DDR4-3600 CL14 (F4-3600C14Q-32GTZNB)
Video Card(s) PowerColor's Red Devil Radeon RX 6900 XT (Navi 21 XTX)
Storage 1 x Western Digital SN850 1GB; 1 x WD Black SN850X 4TB; 1 x Samsung SSD 870EVO 2TB
Display(s) 1 x MSI MPG 321URX QD-OLED 4K; 2 x Asus VG27AQL1A
Case Corsair Obsidian 1000D
Audio Device(s) Raz3r Nommo V2 Pro ; Steel Series Arctis Nova Pro X Wireless (XBox Version)
Power Supply AX1500i Digital ATX - 1500w - 80 Plus Titanium
Mouse Razer Basilisk V3
Keyboard Razer Huntsman V2 - Optical Gaming Keyboard
Software Windows 11
I think all the AI doomsayers are overreacting and exaggerating too much. AI is not dangerous, it just uses the free public available info online.
What is dangerous is the tools such as deepfake, voiceovers, etc, that can be used in malicious purposes, so that can be regulated.
For me, the tools such as BARD, ChatGPT and BingChat are tremendous helpful in my work, helping me complete tasks in 1H, that usually were taking 1 day or more to achieve.
It all depends how you use those tools.
You are basically saying the same thing the creator said regarding bad faith actors. A gun used for hunting was a good tool at first until some bad guys started using them to kill people. This tech will be used for nefarious reasons and there is absolutely no way around it.
 

bug

Joined
May 22, 2015
Messages
13,843 (3.95/day)
Processor Intel i5-12600k
Motherboard Asus H670 TUF
Cooling Arctic Freezer 34
Memory 2x16GB DDR4 3600 G.Skill Ripjaws V
Video Card(s) EVGA GTX 1060 SC
Storage 500GB Samsung 970 EVO, 500GB Samsung 850 EVO, 1TB Crucial MX300 and 2TB Crucial MX500
Display(s) Dell U3219Q + HP ZR24w
Case Raijintek Thetis
Audio Device(s) Audioquest Dragonfly Red :D
Power Supply Seasonic 620W M12
Mouse Logitech G502 Proteus Core
Keyboard G.Skill KM780R
Software Arch Linux + Win10
His concerns are legit, but even without AI, many people today can't tell a true story for a made up one. I will admit I have also fallen for that. But at least I try to track down sources and find alternative, independent reports when something smells fishy.
 

the54thvoid

Super Intoxicated Moderator
Staff member
Joined
Dec 14, 2009
Messages
13,120 (2.39/day)
Location
Glasgow - home of formal profanity
Processor Ryzen 7800X3D
Motherboard MSI MAG Mortar B650 (wifi)
Cooling be quiet! Dark Rock Pro 4
Memory 32GB Kingston Fury
Video Card(s) Gainward RTX4070ti
Storage Seagate FireCuda 530 M.2 1TB / Samsumg 960 Pro M.2 512Gb
Display(s) LG 32" 165Hz 1440p GSYNC
Case Asus Prime AP201
Audio Device(s) On Board
Power Supply be quiet! Pure POwer M12 850w Gold (ATX3.0)
Software W10
You are basically saying the same thing the creator said regarding bad faith actors. A gun used for hunting was a good tool at first until some bad guys started using them to kill people. This tech will be used for nefarious reasons and there is absolutely no way around it.

That's not sound reasoning. Guns were the portable evolution of cannons (an evolution of Chinese fire lances). They were never created for the purpose of hunting, rather, they were invented to win battles. AI is not such a thing; it is simply an entity in its own right, with an exceptionally diverse field of application. Most of which require to be heavily controlled to avoid the consequences.

IMO, AI created in our world will be no different than the people and nations that create it. Greedy, ideological, and/or altruistic. There will be bad AI and good AI. Problem is, a good AI probably wouldn't have the ethics to beat a bad AI. Story of life.
 
Joined
May 17, 2021
Messages
3,043 (2.31/day)
Processor Ryzen 5 5700x
Motherboard B550 Elite
Cooling Thermalright Perless Assassin 120 SE
Memory 32GB Fury Beast DDR4 3200Mhz
Video Card(s) Gigabyte 3060 ti gaming oc pro
Storage Samsung 970 Evo 1TB, WD SN850x 1TB, plus some random HDDs
Display(s) LG 27gp850 1440p 165Hz 27''
Case Lian Li Lancool II performance
Power Supply MSI 750w
Mouse G502
let me retire with the money i made creating the monster and btw beware of the monster i created.
 
Joined
Feb 11, 2009
Messages
5,572 (0.96/day)
System Name Cyberline
Processor Intel Core i7 2600k -> 12600k
Motherboard Asus P8P67 LE Rev 3.0 -> Gigabyte Z690 Auros Elite DDR4
Cooling Tuniq Tower 120 -> Custom Watercoolingloop
Memory Corsair (4x2) 8gb 1600mhz -> Crucial (8x2) 16gb 3600mhz
Video Card(s) AMD RX480 -> RX7800XT
Storage Samsung 750 Evo 250gb SSD + WD 1tb x 2 + WD 2tb -> 2tb MVMe SSD
Display(s) Philips 32inch LPF5605H (television) -> Dell S3220DGF
Case antec 600 -> Thermaltake Tenor HTCP case
Audio Device(s) Focusrite 2i4 (USB)
Power Supply Seasonic 620watt 80+ Platinum
Mouse Elecom EX-G
Keyboard Rapoo V700
Software Windows 10 Pro 64bit
So 40 years ago he had no concerns? Just recently huh…

What was that Jerassic Park quote about scientists?

They move in herds?
 
Joined
Jun 19, 2010
Messages
409 (0.08/day)
Location
Germany
Processor Ryzen 5600X
Motherboard MSI A520
Cooling Thermalright ARO-M14 orange
Memory 2x 8GB 3200
Video Card(s) RTX 3050 (ROG Strix Bios)
Storage SATA SSD
Display(s) UltraHD TV
Case Sharkoon AM5 Window red
Audio Device(s) Headset
Power Supply beQuiet 400W
Mouse Mountain Makalu 67
Keyboard MS Sidewinder X4
Software Windows, Vivaldi, Thunderbird, LibreOffice, Games, etc.
The first results are here since years, used for false information to humans by humans. That can/was/is being used for good and bad human goals.

But if AI gets more than a tool used by humans ... if you then feel the cold breath of that machines in your neck, it will be way too late to stop them.
 

Aquinus

Resident Wat-man
Joined
Jan 28, 2012
Messages
13,171 (2.79/day)
Location
Concord, NH, USA
System Name Apollo
Processor Intel Core i9 9880H
Motherboard Some proprietary Apple thing.
Memory 64GB DDR4-2667
Video Card(s) AMD Radeon Pro 5600M, 8GB HBM2
Storage 1TB Apple NVMe, 4TB External
Display(s) Laptop @ 3072x1920 + 2x LG 5k Ultrafine TB3 displays
Case MacBook Pro (16", 2019)
Audio Device(s) AirPods Pro, Sennheiser HD 380s w/ FIIO Alpen 2, or Logitech 2.1 Speakers
Power Supply 96w Power Adapter
Mouse Logitech MX Master 3
Keyboard Logitech G915, GL Clicky
Software MacOS 12.1
AI is not dangerous, it just uses the free public available info online.
With all due respect, the internet is being scraped regardless of copyright laws or licenses that are being violated. There are some very real concerns in the software space where if you ask ChatGPT to write you some code, it was trained on publically available, open-source software which almost always has some form of license requirement to give the original author recognition for their work. You don't get that when code is "generated" based on trained data that is under a license.

AI can be dangerous just as any piece of software can be, but the idea that they can pull whatever information they want to create a tool that can be sold really opens a pandora's box of who's IP has been quite literally stolen to make this happen. This is China level theft of IP if I'm going to be completely honest.

altruistic
You mean like SBF? :roll:
 
Joined
May 30, 2015
Messages
1,943 (0.56/day)
Location
Seattle, WA
This is a 2 way thing. Use the AI to create better, stronger Antivirus/Antimalware software. See?
Modern problems require modern solutions. ;)

Do you not see the issue with having an AI create security that it is also breaking? If it is being told to program better security, it already knows the solutions to break it because it made it in the first place. There is no layer of obfuscation or abstraction, it's literally building the keys for its own lock.
 

bug

Joined
May 22, 2015
Messages
13,843 (3.95/day)
Processor Intel i5-12600k
Motherboard Asus H670 TUF
Cooling Arctic Freezer 34
Memory 2x16GB DDR4 3600 G.Skill Ripjaws V
Video Card(s) EVGA GTX 1060 SC
Storage 500GB Samsung 970 EVO, 500GB Samsung 850 EVO, 1TB Crucial MX300 and 2TB Crucial MX500
Display(s) Dell U3219Q + HP ZR24w
Case Raijintek Thetis
Audio Device(s) Audioquest Dragonfly Red :D
Power Supply Seasonic 620W M12
Mouse Logitech G502 Proteus Core
Keyboard G.Skill KM780R
Software Arch Linux + Win10
That's not sound reasoning. Guns were the portable evolution of cannons (an evolution of Chinese fire lances). They were never created for the purpose of hunting, rather, they were invented to win battles. AI is not such a thing; it is simply an entity in its own right, with an exceptionally diverse field of application. Most of which require to be heavily controlled to avoid the consequences.
That's if you concentrate on "guns" only. Replace "guns" with "tools", realize AI is just another tool and you have the whole picture.
 

the54thvoid

Super Intoxicated Moderator
Staff member
Joined
Dec 14, 2009
Messages
13,120 (2.39/day)
Location
Glasgow - home of formal profanity
Processor Ryzen 7800X3D
Motherboard MSI MAG Mortar B650 (wifi)
Cooling be quiet! Dark Rock Pro 4
Memory 32GB Kingston Fury
Video Card(s) Gainward RTX4070ti
Storage Seagate FireCuda 530 M.2 1TB / Samsumg 960 Pro M.2 512Gb
Display(s) LG 32" 165Hz 1440p GSYNC
Case Asus Prime AP201
Audio Device(s) On Board
Power Supply be quiet! Pure POwer M12 850w Gold (ATX3.0)
Software W10
That's if you concentrate on "guns" only. Replace "guns" with "tools", realize AI is just another tool and you have the whole picture.

I see the bigger picture. I was inferring the 'guns' metaphor wasn't appropriate given that they were created for a purpose intended to harm others. AI isn't the same. It's end result will be determined by those who guide it.
 
Joined
Apr 26, 2023
Messages
129 (0.21/day)
I see the bigger picture. I was inferring the 'guns' metaphor wasn't appropriate given that they were created for a purpose intended to harm others. AI isn't the same. It's end result will be determined by those who guide it.
And what about nuclear fission? You can use it in the bomb or have nuclear power plant. But in both cases you need a strict law to control it. If you let everyone have a nuclear reactor at home and throw waste to the pile in the backyard it will be very dangerous. The same is with AI. It can be used in many ways, but we need a strict law to control the way we can use AI.

Also some say people at first were skeptical towards steam engines, factories and industrial revolution, but now they accept it as it created better paid jobs and improved our lives. Well, if you compare 18th century with 21st. But what about 19th? Was the quality of life of the factory worker so great? Was it better then quality of life of worker in 18th century? It wasn't because uncontrolled capitalism wasn't so great and stakeholders of the corporations didn't care about workers. The same will be with AI revolution. It will wipe out well paid middle class and we will return to situation where everything is owned by very few and the rest have nothing at all. And you might think people will rebel. well the rich will have robocops to pacify rebellion. While police and soldiers had emphaty to the civilians they were ordered to kill, robocops will not.
 

Aquinus

Resident Wat-man
Joined
Jan 28, 2012
Messages
13,171 (2.79/day)
Location
Concord, NH, USA
System Name Apollo
Processor Intel Core i9 9880H
Motherboard Some proprietary Apple thing.
Memory 64GB DDR4-2667
Video Card(s) AMD Radeon Pro 5600M, 8GB HBM2
Storage 1TB Apple NVMe, 4TB External
Display(s) Laptop @ 3072x1920 + 2x LG 5k Ultrafine TB3 displays
Case MacBook Pro (16", 2019)
Audio Device(s) AirPods Pro, Sennheiser HD 380s w/ FIIO Alpen 2, or Logitech 2.1 Speakers
Power Supply 96w Power Adapter
Mouse Logitech MX Master 3
Keyboard Logitech G915, GL Clicky
Software MacOS 12.1
I was inferring the 'guns' metaphor wasn't appropriate given that they were created for a purpose intended to harm others.
Well, that's not completely accurate. That is one of their uses, sure, but you do realize that people do hunt for food. Maybe not where you live, but it's incredibly common where I live. Well before firearms we did have things like bows and arrows and we used those also against people and for hunting as well. It was a tool and the Native Americans knew that better than just about anyone else. As @bug said, it's a tool that completely depends on how you use it. So no, I completely disagree. It is appropriate and the difference between it and AI are quite literally the same. It's not the tool that's the problem, it's how it's utilized that is.
 
Last edited:

the54thvoid

Super Intoxicated Moderator
Staff member
Joined
Dec 14, 2009
Messages
13,120 (2.39/day)
Location
Glasgow - home of formal profanity
Processor Ryzen 7800X3D
Motherboard MSI MAG Mortar B650 (wifi)
Cooling be quiet! Dark Rock Pro 4
Memory 32GB Kingston Fury
Video Card(s) Gainward RTX4070ti
Storage Seagate FireCuda 530 M.2 1TB / Samsumg 960 Pro M.2 512Gb
Display(s) LG 32" 165Hz 1440p GSYNC
Case Asus Prime AP201
Audio Device(s) On Board
Power Supply be quiet! Pure POwer M12 850w Gold (ATX3.0)
Software W10
Well, that's not completely accurate. That is one of their uses, sure, but you do realize that people do hunt for food. Maybe not where you live, but it's incredibly common where I live. Well before firearms we did have things like bows and arrows and we used those also against people and for hunting. As @bug said, it's a tool that completely depends on how you use it. So no, I completely disagree. It is appropriate and the difference between it and AI are quite literally the same. It's not the tool that's the problem, it's how it's utilized that is.

You're all missing my point. My reply was to this:

A gun used for hunting was a good tool at first until some bad guys started using them to kill people

...which directly infers that 'bad actors' altered the purpose of guns; from hunting to killing. My point was, that guns were not created to hunt - they were created to kill. By definition, their purpose was harmful.

You then need to see that I was pitching that against the concept of AI - which -- unlike guns -- was not deisgned to kill. Bad actors didn't alter the purpose of a gun. Whereas, AI's purpose can be altered (or guided).

The initial post implied guns were not created to be harmful to us, when that is the whole point of their initial premise. Unlike AI, which was pretty much thought of as a tool to help humanity, not hinder it.



Edit: if the item quoted had been a bow and arrrow - yes, it'd been fine. Bows were created to hunt. Guns weren't.
 
Joined
Feb 14, 2012
Messages
1,852 (0.39/day)
Location
Romania
I was watching this, when i stumbled on to this article, kind of a nice coincidence:
 
Top