hi all, this post is ~1.5yr worth of related links collected mainly on a very striking new and fast-moving development/innovation in the field of AI, called deep learning [j,k]. it has been circulating as an idea a few yrs apparently but reached breakthrough status with the google image recognition network [j], which (as now widely reported) self-organized to identify high level objects such as cats. ❗ this is revolutionary, game-changing, technology-disrupting, paradigm-shifting stuff, largely pioneered by Ng.
Deep Learning techniques in particular, very connectionist, look very promising to me and seem to be well on the way to escaping from the google labs [k] into the world-at-large [uh, so maybe there is also a slight halloween angle here! 😆 ]. facebook just announced a sentiment analysis initiative based on it. theres a relatively new google+ group on deep learning already with 2.3k subscribers. yahoo just announced an acquisition of LookFlow also to establish deep learning techniques.
today I read that captcha [i] is claimed broken by a startup & see it reported in several places. its difficult to time posts but thats the tipping point for me on this subject & taking it as my cue to launch this blog post & this big link collection on the topics.
theres a big confluence of different factors aligning on AI and lots of remarkable news on the subject. obama announced a federal brain research initiative [b]. Markram [c] in europe was awarded over $1.3B by the european research consortium for work in developing a large-scale brain simulation. jeff hawkins [l] has been in the news lately also promoting an open-source type attack on the problem via his own directions. kurzweil was hired by google & has his own documentary![m10] IBM has announced various initatives also [e]. just heard that deep-pocket Paul Allen wants to get in on the action too! [a9] 😯
new book by Eliasmith, “how to build a brain” [a7] & others too.
these research projects are massively ambitous, have potentially staggering scientific, social, and business/economic implications—imagine what the next google might look like!—and are naturally compared to other Big Science type projects eg mapping the human genome or, frankly, the mother of all scientific projects, the LHC/Higgs search. but, hey, then, turning down the frothing hypemeter just a notch, of course lets also not forget the outcome of these types of projects as far as expectations versus reality, which was a particularly sizeable gap with the genome mapping in particular. on the other hand, a Nobel for the Higgs particle was just awarded weeks ago….!
and elsewhere, oh yeah, theres some borderline-fringe stuff on the so-called singularity circulating! [m] cant believe that even the conservative academics eg Moshe Vardi [m6] are getting in on the speculation.
google’s deep learning breakthrough was the original impetus for the blog post but as you can see its almost comically expanded beyond the original scope over time, but still relatively short time! that is a reflection of both my wideranging reading but also the intrinsic memetic explosion going on in the area.
so, its really invigorating to see this subject really popping/buzzing/crackling/snapping at this nanosecond after many years of studying it. who can keep track of it all? not implying that I can!
is this so-called critical mass, or what? well dont know about whether its a critical mass to *achieve* AI but it seems certainly a critical mass of new interest in doing so. may we all live in exciting/fast-moving/developing times! 😎
there are many links here organized into sections based on my own classification ideas. not saying its perfectly sorted [thats a near-impossible goal] but its hopefully somewhat convenient and understandable. hope you enjoy reading it all as much as I did collecting it! 😀
so, onward! viva la revolution! 💡
[oh yeah and when is it gonna be possible to get a good paying job working on this stuff, anyway? as the old expression goes “dont quit your day job™” 😉 ]
a. ai
- 1. As Machines Get Smarter, Evidence They Learn Like Us | Simons Foundation
- 2. Why can’t my computer understand me?
- 3. Algorithms Are the New Content Creators, and That’s Bad News for Humans | Wired Opinion | Wired.com
- 4. Deep learning – Wikipedia, the free encyclopedia
- 5. John McCarthy — Father of AI and Lisp — Dies at 84 | Wired Enterprise | Wired.com
- 6. How to build a human brain (with a computer 1,000x faster than today’s) | Fox News
- 7. How to Build a Brain: A Neural Architecture for Biological Cognition (Oxford Series on Cognitive Models and Architectures): Chris Eliasmith: 9780199794546: Amazon.com: Books
- 8. Skynet, HAL, the MCP: Artificial Intelligence Near, Not So Scary | Innovation Insights | Wired.com
- 9. Inside Paul Allen’s Plan to Reverse-Engineer the Human Brain – Wired Science
b. us brain map
- 1. Project Seeks to Build Map of Human Brain – NYTimes.com
- 2. Brain Project Draws Presidential Interest – ScienceInsider
- 3. BRAIN Initiative Challenges Researchers to Unlock Mysteries of Human Mind | The White House
- 4. Seeking the Connectome, a Mental Map, Slice by Slice – NYTimes.com
- 5. 3 Radical New Brain-Mapping Tools Obama’s Plan Could Deliver | Wired Science | Wired.com
- 6. Proposed Brain Mapping Project Faces Significant Hurdles – NYTimes.com
- 7. BRAIN Initiative – Wikipedia, the free encyclopedia
c. markram
- 1. Human Brain Project – Introduction
- 2. BBC NEWS | Technology | Artificial brain ’10 years away’
- 3. European Researchers Win $1.3 Billion To Simulate The Human Brain | Popular Science
- 4. The $1.3B Quest to Build a Supercomputer Replica of a Human Brain | Wired Science | Wired.com
- 5. Henry Markram – Wikipedia, the free encyclopedia
- 6. Human Brain Project (EU) – Wikipedia, the free encyclopedia
- 7. Blue Gene – Wikipedia, the free encyclopedia
- 8. Blue Brain Project – Wikipedia, the free encyclopedia
d. other
- 1. Creating Artificial Intelligence Based on the Real Thing – NYTimes.com
- 2. Smarter Than You Think – Aiming to Learn as We Do, A Machine Teaches Itself – NYTimes.com
- 3. What Should a Computational Theory of Cortex Explain? / Valiant – YouTube
- 4. What is the most complex artificial neural network created to date? – Cognitive Sciences Beta – Stack Exchange
- 5. So It Begins: Darpa Sets Out to Make Computers That Can Teach Themselves | Danger Room | Wired.com
- 6. Ben Goertzel is on a mission to build an “AI Toddler”
- 7. Ben Goertzel – Wikipedia, the free encyclopedia
- 8. Physicist Proposes New Way To Think About Intelligence | Inside Science
- 9. Artificial Brains – The quest to build sentient machines
- 10. Universe, human brain and Internet have similar structures – Sci/Tech – DNA
- 11. Marcus Hutter – Wikipedia, the free encyclopedia
- 12. Douglas Hofstadter, the man who would teach machines to think / Atlantic
e. ibm
- 1. IBM creates learning, brain-like, synaptic CPU | ExtremeTech
- 2. IBM Reveals the Biggest Artificial Brain of All Time – Popular Mechanics
- 3. The Brain in the Machine: I.B.M’s Compass : The New Yorker
- 4. IBM Dreams Impossible Dream With Clone of Human Brain | Wired Enterprise | Wired.com
- 5. IBM devises software for its experimental brain-like chips – Network World
- 6. IBM Develops Programming Language Inspired By The Human Brain – Forbes
f. mit
g. spaun
- 1. Meet Spaun, The Most Complex Simulated Brain Ever | Popular Science
- 2. Artificial Brain: ‘Spaun’ Software Model Mimics Abilities, Flaws Of Human Brain
- 3. A Large-Scale Model of the Functioning Brain
h. milestones
- 1. Google’s Self-Driving Cars: 300,000 Miles Logged, Not a Single Accident Under Computer Control – Rebecca J. Rosen – The Atlantic
- 2. SIRI RISING: The Inside Story Of Siri’s Origins — And Why She Could Overshadow The iPhone
- 3. Robot musician improvises, jams with humans – CNN.com
- 4. In a First, an Entire Organism Is Simulated by Software – NYTimes.com
- 5. Mind vs. Machine – Magazine – The Atlantic
i. captcha
- 1. These Coders Say They Taught A Computer To Crack CAPTCHA
- 2. Vicarious AI breaks CAPTCHA ‘Turing test’ | KurzweilAI
- 3. Vicarious announces $15 million funding for AI software based on the brain | KurzweilAI
- 4. CAPTCHA Busted? AI Company Claims Break of Internet’s Favorite Protection System – Wired Science
- 5. CAPTCHA, Wikipedia
j. google vision
- 1. In a Big Network of Computers, Evidence of Machine Learning – NYTimes.com
- 2. Scientists See Advances in Deep Learning, a Part of Artificial Intelligence – NYTimes.com
- 3. Official Blog: Using large-scale brain simulations for machine learning and A.I.
- 4. Now You Can Build Google’s $1M Artificial Brain on the Cheap | Wired Enterprise | Wired.com
- 5. Google Research Publication: Building High-level Features Using Large Scale Unsupervised Learning
- 6. [1112.6209] Building high-level features using large scale unsupervised learning
- 7. Google creates ‘artificial brain’ – and it immediately starts watching cat videos | Mail Online
- 8. Google’s Artificial Brain Learns to Find Cat Videos | Wired Science | Wired.com
- 9. Google Erects Fake Brain With … Graphics Chips? | Wired Enterprise | Wired.com
- 10. World’s Largest Artificial Neural Network
- 11. The Man Behind the Google Brain: Andrew Ng and the Quest for the New AI | Wired Enterprise | Wired.com
- 12. How Ray Kurzweil Will Help Google Make the Ultimate AI Brain | Wired Business | Wired.com
- 13. Google Hires Brains that Helped Supercharge Machine Learning | Wired Enterprise | Wired.com
- 14. Computer Brain Escapes Google’s X Lab to Supercharge Search | Wired Enterprise | Wired.com
- 15. Andrew Ng – Wikipedia, the free encyclopedia
- 16. Indexing the world: Google receives software that means it can intelligently identify any object on the planet | Mail Online
k. deep learning
- 1. Why Facebook Is Teaching Its Machines to Think Like Humans | Wired Enterprise | Wired.com
- 2. Stanford algorithm analyzes sentence sentiment, advances machine learning | Engineering
- 3. Facebook Chases Google’s Deep Learning with New Research Group | MIT Technology Review
- 4. These Guys Are Teaching Computers How to Think Like People | Wired Enterprise | Wired.com
- 5. Deep Learning – Community – Google+
- 6. Is deep learning a revolution in AI? New Yorker
- 7. Deep Learning and Applications in Neural Networks, 36 slides
- 8. Deep Learning resources
- 9. Researcher Dreams Up Machines That Learn Without Humans (Bengio)
l. hawkins
- 1. HIERARCHICAL TEMPORAL MEMORY including HTM Cortical Learning Algorithms
- 2. Intelligence and Machines: Creating Intelligent Machines By Modeling the Brain / Hawkins – YouTube
- 3. Jeff Hawkins – Wikipedia, the free encyclopedia
- 4. What the Digital Brains of the Future Might Be Like – Alexis C. Madrigal – The Atlantic
- 5. Out in the Open: Palm Pilot Inventor Wants to Open Source the Human Brain | Wired Enterprise | Wired.com
m. future/vision/singularity
- 1. Eternal Life Through Robots? The Bizarre Theory That Humans Will Meld With Machines | Media | AlterNet
- 2. Singularity: Kurzweil on 2045, When Humans, Machines Merge – TIME
- 3. Ray Kurzweil – Wikipedia, the free encyclopedia
- 4. Futurist Ray Kurzweil Pulls Out All the Stops (and Pills) to Live to Witness the Singularity
- 5. BBC News – A Point of View: Will machines ever be able to think?
- 6. The Consequences of Machine Intelligence – Moshe Y. Vardi – The Atlantic
- 7. Economics Of The Singularity / Hanson – IEEE Spectrum
- 8. Finite-time singularity in the dynamics of the world population, economic and financial indices / Johansen
- 9. Long-Term Growth As A Sequence of Exponential Modes / Hanson
- 10. Transcendent Man (2009) – IMDb
Pingback: DEEP LEARNING REVOLUTION, summer 2015, state of the art & topnotch links | Turing Machine