big data summer 2017, revolution + firehose

hi all, have blogging up a storm for years now, coming up on the ยฝ decade anniversary. at times as far as topics its been like “kid in a candy store” for me. as the chinese say “may you live in interesting times”. there is so much going on these days, so many moving parts. we seem to be in the middle of major simultaneous revolutions in multiple fields, some of my favorites like CS+ physics. CS advancements in particular are rippling across many fields. CS is historically the field of infotech. but as noted in this blog, science is becoming increasingly about analysis of info/ data. a hybrid of CS+ statistical science is leading the way in analyzing Big Data. Big Data covers many areas and for years there was mostly a lot of focus on the hardware aspects. theres been huge innovation there and weve got awesome capabilities, systems, libraries for stuff like that, like nosql and graph databases. very impressive!

so now with those solid foundations in place, some of the applications/ advances/ breakthrus can commence. and we’re already seeing the “early” fruits all over the place. yet my feeling is that wrt the “long run” all of this is maybe only in 2nd gear.

have been tracking Big Data in my massive bookmark/ link piles. as you can imagine, thats a very difficult challenge, but am largely up to it with my hardcore cybersurfing and hacker tools eg bookmark export. and so a “huge” ~215 link list is just a drop in the bucket…!

made a conscious decision to hold off on writing up the links “for awhile” because AI has been taking center stage with deep learning and its largely merged with a lot of the cutting edge big data field. its getting increasingly hard to separate/ draw boundaries between them. but then, holy cow! THREE YEARS flew by in a flash. have been tracking a few big data related links in AI posts otherwise, but now my big data links runneth over and time to unleash/ release them. was somewhat waiting for a headline-grabbing event, but in a way they are happening constantly…

Continue reading


latest on killing copenhagen interpretation via fluid dynamics

โญ โ— ๐Ÿ’ก ๐Ÿ˜Ž ๐Ÿ˜ฎ โค hi all. bohr was transfixed by so-called "complementarity"; its said schroedingers cat is both alive and dead, and curiosity killed the cat. wikipedia states[n6]

In the Copenhagen interpretation of quantum mechanics, the wave function is the most complete description that can be given of a physical system.

but wait, if that is against inquiring deeper, isnt that nearly an anti-curiosity-investigation-research position/ pov? and isnt anti-curiosity-investigation-research nearly anti-science? ๐Ÿ˜ฎ

copenhagen interpretation is sometimes referred to as the shut up and calculate ideology by questioners/ challengers/ critics in a statement originating with one of them, Mermin, an adept popsci writer and fan of Bells work. here is a famous quote that sounds like a near restatement of the copenhagen interpretation by Feynman:

Do not keep saying to yourself, if you can possibly avoid it, “But how can it be like that?” because you will get “down the drain”, into a blind alley from which nobody has yet escaped. Nobody knows how it can be like that.

I think I can safely say that nobody understands quantum mechanics.

now how about a somewhat radical quote/ response from Daniel Sank, Phd working for Google QM labs?

The other day someone from the WSJ asked me to explain why quantum mechanics is weird.

I went off on a rather well-reasoned and carefully articulated rant about how it’s not weird and that people only say that to sound cool.

I even went so far as to say that Feynman’s famous statement that {anyone who thinks they understand quantum mechanics is wrong} is destructive, stupid, and should not be repeated.

whoa, strong words there! however maybe somewhat unexpectedly, both somewhat agree/ disagree! yet, alas, somehow think DS is not really intending to challenge the copenhagen interpretation with his dramatic excoriation of feynman!* DS is also on the (chat) record as averse to/ strongly rejecting “alternative interpretations”. which to me is not really scientific, where to me conceptual evolution/ scientific progress inherently entails/ involves never stopping/ ceasing questioning how can it be like that?

oh, coincidentally right around writing all this, just ran into another striking quote by John Rennie a very high ranking member of physics stack exchange on the “1st Law,” with high ranking mod ACuriousMind immediately agreeing:

no physicist shall discuss interpretations of quantum mechanics or by inaction allow interpretations of quantum mechanics to be discussed.

lol and now this seems to reach/ degenerate to the absurd levels of Epimenides paradox when one asks the simple question, are Bohr/ Heisenberg, the founders of the Copenhagen interpretation, physicists? …so is this physics or fight club? ๐Ÿ˜ฎ o_O ๐Ÿ™„

* further search jujitsu by me, managed to turn up another striking quote by DS expressly rejecting Copenhagen interpretation… more strong words!

Listen to me very closely: I am a quantum computing professional and I think the Copenhagen interpretation is not even self-consistent and therefore entirely inadmissible as a theory of Nature.

and to finish on a different note, think this captures something relevant/ accurate/ typically unspoken “between the lines” by mod ACuriousMind, a sort of “non-interpretation” approach at least )( admitted openly/ candidly/ honestly:

Of those named, Copenhagen is the most popular, but my impression is that a significant number of people actually doing quantum physics every day share my personal disdain for all the squabbles around “interpretations”.

(so then, bottom line/ in conclusion… Copenhagen as that which shall not be named? aka scientific omerta, “code of silence”) ๐Ÿ˜ณ ๐Ÿ˜ฎ ๐Ÿ™„

โญ โญ โญ

have been collecting physics links on a diverse set of topics that are not unified yet but think will someday be unified. the general area is now sometimes known as Pilot Wave Hydrodynamics (PWH) also aka/ known as “oil drop dynamics experiments”. the Bohmian pilot wave was speculated on for many decades, and soliton theory combined with new experimental findings has given rise to a new reality, science, and growing research area/ program/ paradigm! but it exists alongside in a tension right now with “standard” quantum mechanics.

the stage has been set! its two large plates shearing against each other. when will the inevitable top/ pivotal showdown/ confrontation/ conflict/ earthquake occur? think its just a matter of time! (admittedly 1 is far much smaller than the other right now, but relatively shortly, predict that will flip-flop.) my feeling/ estimate/ prediction is there is at least 1 nobel to be won in the next 5-10 yrs in this area, and several in store over several decades!* signifying/ corresponding with an imminent genuine physics paradigm shift/ revolution in the 21st century at least on the scale of QM in the 20th.

* ๐Ÿ˜ณ o_O (note, however, some fineprint/ hedging/ reality check on this superficially bold-appearing claim! nobels are clearly not comprehensive/ thorough/ totally evenhanded, eg Einstein did not win one for relativity! also, they are often awarded up to decades after the date of the actual accomplishment! therefore to thoroughly invalidate the claim might take decades!)

would like to write a comprehensive survey based on several years of juicy links but thats a herculean task. even just collecting/ writing up the latest batch is a formidable task. these are some of the big highlights for me.

there are a lot of boundary-pushing experiments in qm lately.[a]

Continue reading

collatz adversarial attack and the light at end of tunnel

โ— ๐Ÿ’ก ๐Ÿ˜€ ๐Ÿ˜Ž โญ last month was quite a tour de force against collatz, the culmination of many months or even years of hard work and creative ideas, and many different approaches all combined (pyramid-like) to lead to very solid results verging on a “candidate solution”. another theme that was pursued earlier here are “adversarial algorithms” which has been used with great success eg by Google/ Deepmind against Go. the basic theme is “two algorithms competing against each other” so to speak. along these lines there is one final idea to try against the prior Collatz “solution”.

Continue reading

norbert blum P vs NP attack goes CYBER-SCIENCE-VIRAL!

โญ ๐Ÿ’ก โ— ๐Ÿ˜€ ๐Ÿ˜Ž โค hi all! want to write a lot on this, have all kinds of impressions and things to say on one of my favorite topics in the world for 2ยฝ decades now and which this blog is partly dedicated to, but am starting out by just collecting some links vacuumed up mostly today for others to check out, the top locations for commentary. unf there is not really a key/ central place so far where all the action is happening. will be adding to this post as time goes on. its very hard to figure out when to time a post wrt very fast moving developments like this, but my trigger just hit mostly right after RJLipton[a10] blogged about it. oh yeah, that comment by gowers that “I think it may reach the level where the experts feel that it needs to be checked” is highly triggering for me too (referring ofc to himself in 3rd person, maybe being more than a bit )( coy about this— doncha just love hardcore mathematicians! which reminds me of the joke about shoelaces…) … oh and then theres also fortnow who literally wrote the book on it! (oh yeah wrt that theres this by RJL too!) ๐Ÿ˜›

it looks like the Norbert Blum paper[a14][a15] basically went “pop/ scientific viral” today or so probably after mentions on Reddit[a8][a9] and Hacker News.[a11] of the experts Trevisan[a1] was the first to wager a reaction along with some curious onlookers like Baez[a2] and verging-on-jester-or-gadfly-or-even-troll Motl[a5] who along with some mild conspiracy theory about CS research(ers) (lol!) says, wrt the #1 top problem in TCS…

Except that unlike the case of string theory, there exists absolutely no rational evidence that there exists something stunning waiting to be discovered.

@#$% ๐Ÿ˜ก ๐Ÿ‘ฟ โ— whoa, fighting words and/ or near-sacrilege there! excuse me, what is “stunning” is that the problem with $1M prize over 1ยฝ decade has eluded/ stymied/ thwarted the worlds greatest scientific minds for almost ยฝ century now! and the proof either way, in whatever shape or form, will be assuredly stunning to anyone who isnt jaded or a nihilist! hey physics bozo! think of a great experiment that guaranteed leads to an extraordinary answer either way! arent there any examples like that in your field anyway? or is maybe someone looking a little envious over there? or out of the loop or maybe dont even know how to flirt at all? :mrgreen:

the TCS stackexchange post by a n00b newbie (who didnt know enough to not ask! hows that for “zen beginners mind”?) is now up to 136-4 votes and 28K hits (thursday eve 8/17).[a3] (joy that the lame heavyhanded/ constricting/ dictatorial policy of the self-appointed cyber spoilsports and partypoopers also long criticized here in this blog, is overruled by striking mass opposition!) that post slipped my radar for a few days! found the paper on the 1st day (monday this wk) but thought it might stay “unviral” (you know, like those killer viruses locked in the… thawing… arctic, right?) based esp on the last Hauptmann attempt.[a12][a13]

discovered the big commotion today via reddit myself and spent excited hours poking through sites! but my hits on the Hauptmann blog post had been creeping/ climbing up massively all week, merely from google searches (many from germany), and figured it was due to questions on the Blum attempt. turns out theyre both profs at the same university! (Bonn/ Germany) pardon me but wtf?!?… some kind of story there eh? are any reporters listening?

cyberspace is such a joy sometimes, in my quasi-bipolar days, mostly-sometimes seemingly very flat for days, weeks, months, even years at a time, this is a massive manic spike for me… the adrenalin is flowing! didnt sleep as well this week! there is so much cybersynchronicity to this, must admit, its a very rare event, am myself (and defensively, some others are too) having a bit of a mini-cyber-orgasm so far… ๐Ÿ’ก ๐Ÿ˜ฎ o_O ๐Ÿ™„ โ—

Continue reading

google gender/ diversity memo firestorm, other tech+gender stuff

hi all. what a firestorm this week. james Damore got fired over his memo analyzing gender differences at google, citing scientific research into evolutionary psychology. theres so much media froth on this feel sure that it will continue into next week, but my bookmarks runneth over at this point. “triggered”! like the essay itself: touched a nerve….

this comes at a very bad time for Google which was already under investigation for hiring balances by the US labor dept[a23] and female engineers are considering a class action lawsuit.[a14][a15] looks from here like Google is under pressure from multiple/ all sides/ fronts, maybe in a catch22/ no-win situation wrt this issue. aka a lightning rod, just like damore himself! its turned into a black eye/ PR nightmare for everyone involved…

Continue reading