Well, I must say that I'm pleasantly surprised with the comments so far. I was actually expecting that this would be quickly shot down as either unoriginal or fundamentally flawed. But instead it seems no one has caught on to what this post is actually claiming, so I suppose I should now be very blunt about it.
At the beginning of the blog post, it claims that it explains 2 things:
1. where exactly might you be able to use learning algorithms where you can't just use existing physics theories instead
2. a hands on guide to applying learning algorithms in these situations
This is physicist code for "this blog post claims that it solves a major unsolved problem in physics." Let me explain.
Currently, we have the standard model and general relativity, which have been experimentally verified to extreme precision but are fundamentally incompatible with each other. So people have proposed theories of everything such as string theory, loop quantum gravity, and information/digital physics (which I'm obviously a fan of) to resolve these incompatibilities.
One of the biggest problems in fundamental physics right now is that the standard model and general relativity have been verified to such precision that it's hard to think of a practical experiment to show how they are wrong. The conventional wisdom is that this is only possible if we do things like measure the Planck scale or what happens inside a black hole, which are completely impractical on human timescales.
What this post proposes is that you actually don't need to measure the Planck scale or what happens in a black hole in order to test the proposed theories of everything, and instead you can do it with a sufficiently powerful computer simulation and a sufficiently good brain-computer interface. If our technology keeps improving exponentially, this may be possible in the next several decades.
So yeah, I made a bit of a white lie when I framed this post as a summary of recent research in information physics. I can back up almost everything in the post with the sources I linked to, but the part about the 0 or 1 experiment and predicting its outcome using Solomonoff induction is actually original research on my part, and I suspect it would actually be a very big deal if this works the way I think it does.
So here are the possible outcomes for this blog post:
1. The problem in physics I just described is actually already solved.
2. The blog post is fundamentally flawed, and/or it actually doesn't solve the problem that I'm claiming it solves.
3. The blog post actually does solve a major unsolved problem in physics, and this is a huge deal.
This is why I am so surprised at the comments I'm getting so far, since this proposal for experimentally testing theories of everything seems to be passing the internet commenter test. So if no one on HN finds anything seriously wrong with the blog post, can we get people like Scott Aaronson, John Baez, Juergen Schmidhuber, Stephen Hawking, or people of that caliber to look at it so we can get a more definitive answer to whether this actually solves an unsolved problem in physics?
Also, kudos to Xcelerate's comment, which is the closest to the point I was trying to get at with the blog post.
It is not clear to me that you realize that Solomonoff induction is a mathematical argument, not a practical algorithm. To run it at the level of generality necessary to discover the laws of physics is computationally infeasible. In fact, it's one of those cases where calling it "computationally infeasible" is an inadvertent understatement of the problem, because English doesn't have gradations for this level of difficulty. Merely a "singularity" doesn't help this problem; you need more computation than our physics appears to allow.
Yes, I know that Solomonoff induction is completely impractical for real life machine learning. My point was that if you can survive in the simulation to the point where you see either the 0 or the 1, we don't have any way even in theory (let alone in practice) to guess the probabilities of seeing a 0 or 1, unless you use some sort of learning algorithm. You can use any learning algorithm for this; it doesn't have to be Solomonoff induction.
But your argument seems to fundamentally rest on Solomonoff induction. Put any real algorithm in there, and now you need to ensure that 1. the biases of the algorithm encompass a hypothesis that matches the data and 2. the algorithm will be able to arrive at that hypothesis given a real data stream, and, ideally, a real amount of computation. Both of these are hard questions, in the strongest sense of the term.
And once you open that door, well, all you've really done is restate the fact that learning how the universe works seems to be really difficult.
I would note that "computation" is work done over time. Causality.
There may exist an alternate form of causality that isn't time bound, which may be exposed here over short periods of time. I would hesitate to judge it "computationally infeasible" until we know more. :)
I think it's important to distinguish arguments that hypothesize that our understanding of physics is fundamentally, deeply flawed, from arguments that are based on our current understanding of physics. I can't prove that our understanding of physics isn't deeply flawed and there isn't some source of infinite computation somehow available to us; for instance, one proposed explanation of the Fermi Paradox is that all civilizations escape to a physics/computation regime more congenial to civilization before colonizing the galaxy. But it's still important to know when we're engaging in flights of fancy vs. speculating based on what we know.
And given that the topic in question is plumbing the depths of physics in the first place, this is perhaps a notch more important than it might otherwise be. How would we discover that physics has an infinite/acausal computation mechanism if we first must use Solomonoff induction to discover that, when we can only afford to use Solomonoff induction to discover that if we harness that computation?
Well, there are things we know and things we will know. If we take the hypothetical "all knowing I", we assume it has zero security and all knowledge (wisdom). With individuals, we have high security (you can't know what I'm thinking) and low wisdom. So, knowledge plays a part in all this, as is evident of the result of causality. There's a sutra that deals with this concept as well.
I have a hypothesis that reality is backed by a blockchain data structure, which is why it's robust and fairly immutable. One might create a simple reality based on a blockchain data structure and then attempt to model causality/matrix rotations with that structure in such a way that the behavior of "gravity" noted in a gyroscope can be observed to not occur, given the nature of the scientific method. i.e. model rotations in a blockchain without generating gravity/precision and you've disproved my hypothesis.
The correlation with this test and reality would be allowing brief access to a "search" across all knowledge (which could be optimized behind the scenes) and then allow that knowledge to exist until the block is closed, at which point you are left with whatever gets closed in the block and the resulting forces that have to occur to rationalize the rotation. Rinse and repeat.
Probably doing a horrible job of explaining it. First time I've really written it down.
"So if we hooked up two people’s brains together in year 2050, would they feel like a single person?...We won’t know until we actually try it. If the answer is no then the rest of this blog post is completely irrelevant..." My guess is that if this were done to people who, up to that point, had lived independent lives (i.e. not born conjoined at the brain), they would each feel like individuals who had suffered some sort of major stroke, rather than that they had become a single person.
With regard to the cloning phase of your argument, is this not effectively the same as what the many worlds interpretation of quantum mechanics says happens all the time? FWIW, while I don't feel as if those other versions of me are me (assuming many-worlds is true), I realize that I am in no position to assert that I am the 'real' me, and in fact that it is beside the point to ask which one is.
When I wrote "predict" there, I was referring to whether the predicted probabilities approach the true underlying probabilities, and Solomonoff induction can "predict" a true random number generator in that sense because its predicted probabilities will approach those of the random number generator. [1] However, if you tried to use it to predict a halting oracle, the halting oracle would be deterministic but Solomonoff induction would never be able to predict it with complete confidence, and this is what I was referring to in that paragraph.
But you're right that random numbers are inherently unpredictable; maybe I should add another footnote explaining what I meant there. (Edit: I added a clarification to the paragraph you quoted.)
One of the principles of turing machines is that they are deterministic. In that vain, there exists no programmable RNG except for pseudo random ones. One has to ask oneself if piping a transform of the digits of a transcendental real number is a violation to this rule -- thus what is random really? Is random the lack of ability to find a correlation or program to reproduce it -- or is it something more like Komogrolov complexity? These are tough and inscrutable questions. Shannon, Turing, Curry, Church, Post, and others explored them deeply. Information theory gets extremely existential and esoteric. Is randomness a monad of our universe? Or is physicals and natural chaos just extremely leathery when it comes to extracting the generating program? Our lives depend on it. But either way, we'll carry on. Nature you goddamn enigma.
general relativity: http://www.feynmanlectures.caltech.edu/II_42.html
quantum electrodynamics: "QED: The Strange Theory of Light and Matter" or http://vega.org.uk/video/subseries/8
standard model: http://quantumdiaries.org/2010/02/14/lets-draw-feynman-diaga...
conceptual core of quantum mechanics: http://scottaaronson.com/democritus/lec9.html
history of quantum mechanics: "The Second Creation" and "The Infinity Puzzle"