Skip to main content

Home/ Advanced Concepts Team/ Group items tagged machine

Rss Feed Group items tagged

Luís F. Simões

Poison Attacks Against Machine Learning - Slashdot - 1 views

  • Support Vector Machines (SVMs) are fairly simple but powerful machine learning systems. They learn from data and are usually trained before being deployed.
  • In many cases they need to continue to learn as they do the job and this raised the possibility of feeding it with data that causes it to make bad decisions. Three researchers have recently demonstrated how to do this with the minimum poisoned data to maximum effect. What they discovered is that their method was capable of having a surprisingly large impact on the performance of the SVMs tested. They also point out that it could be possible to direct the induced errors so as to produce particular types of error.
  •  
    http://arxiv.org/abs/1206.6389v2 for Guido; an interesting example of "takeover" research
LeopoldS

physicists explain what AI researchers are actually doing - 5 views

  •  
    love this one ... it seems to take physicist to explain to the AI crowd what they are actually doing ... Deep learning is a broad set of techniques that uses multiple layers of representation to automatically learn relevant features directly from structured data. Recently, such techniques have yielded record-breaking results on a diverse set of difficult machine learning tasks in computer vision, speech recognition, and natural language processing. Despite the enormous success of deep learning, relatively little is understood theoretically about why these techniques are so successful at feature learning and compression. Here, we show that deep learning is intimately related to one of the most important and successful techniques in theoretical physics, the renormalization group (RG). RG is an iterative coarse-graining scheme that allows for the extraction of relevant features (i.e. operators) as a physical system is examined at different length scales. We construct an exact mapping from the variational renormalization group, first introduced by Kadanoff, and deep learning architectures based on Restricted Boltzmann Machines (RBMs). We illustrate these ideas using the nearest-neighbor Ising Model in one and two-dimensions. Our results suggests that deep learning algorithms may be employing a generalized RG-like scheme to learn relevant features from data.
darioizzo2

Integrating Machine Learning for Planetary Science: Perspectives for the Next Decade - 3 views

Hey! We also have an added review paper on ML/AI and G&C -> https://link.springer.com/article/10.1007/s42064-018-0053-6, weird they found those other papers instead ... I guess the keyword machine...

AI PHY

zoervleis

Moral Machine - 1 views

shared by zoervleis on 17 Aug 16 - No Cached
  •  
    "A platform for public participation in and discussion of the human perspective on machine-made moral decisions" Machine Ethics is basically the return of philosophy through code. Here you can learn a bit about it, and help the MIT collect data on how humans make choices when faced with ethical dilemmas, and how we perceive AIs making such choices.
Thijs Versloot

Deep Learning Machine Teaches Itself Chess in 72 Hours, Plays at International Master L... - 1 views

  •  
    In a world first, an artificial intelligence machine plays chess by evaluating the board rather than using brute force to work out every possible move. It's been almost 20 years since IBM's Deep Blue supercomputer beat the reigning world chess champion, Gary Kasparov, for the first time under standard tournament rules.
  •  
    The disadvantage in this kind of engine lies exactly in its inability to extrapolate. You might actually be able to beat it if you play like an idiot.
LeopoldS

Machine Made of Lego Builds Anything You Want - Out of Lego | Gadget Lab | Wired.com - 5 views

  •  
    nice ....
  •  
    "which raises the possibility - theoretically at least - that the machine could, with some modifications, build a copy of itself." - very interesting way to say that the machine can't build a copy of itself... But generally, this is ubercool :-) When you're getting one?
  •  
    we should have built a rep-rap
Giusi Schiavone

Antigravity Machine Patent Draws Physicists' Ire - 2 views

  •  
    Antigravity Machine Patent
  •  
    Do they aim for the Ig Nobel prize?? Just great!!
ESA ACT

PLoS Computational Biology - Machine Learning and Its Applications to Biology - 0 views

  •  
    A Tutorial on machine learning. Esp. the unsupervised learning could be interesting.
ESA ACT

Emotional Machines, Emotion Oriented Programming, Affective Computing - 0 views

shared by ESA ACT on 24 Apr 09 - Cached
  •  
    Emotional Machines
darioizzo2

Machine learning leads mathematicians to unsolvable problem - 1 views

  •  
    Learnability cannot be proven! An important theoretical brick on machine learning capabilities.
Dario Izzo

Miguel Nicolelis Says the Brain Is Not Computable, Bashes Kurzweil's Singularity | MIT ... - 9 views

  •  
    As I said ten years ago and psychoanalysts 100 years ago. Luis I am so sorry :) Also ... now that the commission funded the project blue brain is a rather big hit Btw Nicolelis is a rather credited neuro-scientist
  • ...14 more comments...
  •  
    nice article; Luzi would agree as well I assume; one aspect not clear to me is the causal relationship it seems to imply between consciousness and randomness ... anybody?
  •  
    This is the same thing Penrose has been saying for ages (and yes, I read the book). IF the human brain proves to be the only conceivable system capable of consciousness/intelligence AND IF we'll forever be limited to the Turing machine type of computation (which is what the "Not Computable" in the article refers to) AND IF the brain indeed is not computable, THEN AI people might need to worry... Because I seriously doubt the first condition will prove to be true, same with the second one, and because I don't really care about the third (brains is not my thing).. I'm not worried.
  •  
    In any case, all AI research is going in the wrong direction: the mainstream is not on how to go beyond Turing machines, rather how to program them well enough ...... and thats not bringing anywhere near the singularity
  •  
    It has not been shown that intelligence is not computable (only some people saying the human brain isn't, which is something different), so I wouldn't go so far as saying the mainstream is going in the wrong direction. But even if that indeed was the case, would it be a problem? If so, well, then someone should quickly go and tell all the people trading in financial markets that they should stop using computers... after all, they're dealing with uncomputable undecidable problems. :) (and research on how to go beyond Turing computation does exist, but how much would you want to devote your research to a non existent machine?)
  •  
    [warning: troll] If you are happy with developing algorithms that serve the financial market ... good for you :) After all they have been proved to be useful for humankind beyond any reasonable doubt.
  •  
    Two comments from me: 1) an apparently credible scientist takes Kurzweil seriously enough to engage with him in polemics... oops 2) what worries me most, I didn't get the retail store pun at the end of article...
  •  
    True, but after Google hired Kurzweil he is de facto being taken seriously ... so I guess Nicolelis reacted to this.
  •  
    Crazy scientist in residence... interesting marketing move, I suppose.
  •  
    Unfortunately, I can't upload my two kids to the cloud to make them sleep, that's why I comment only now :-). But, of course, I MUST add my comment to this discussion. I don't really get what Nicolelis point is, the article is just too short and at a too popular level. But please realize that the question is not just "computable" vs. "non-computable". A system may be computable (we have a collection of rules called "theory" that we can put on a computer and run in a finite time) and still it need not be predictable. Since the lack of predictability pretty obviously applies to the human brain (as it does to any sufficiently complex and nonlinear system) the question whether it is computable or not becomes rather academic. Markram and his fellows may come up with a incredible simulation program of the human brain, this will be rather useless since they cannot solve the initial value problem and even if they could they will be lost in randomness after a short simulation time due to horrible non-linearities... Btw: this is not my idea, it was pointed out by Bohr more than 100 years ago...
  •  
    I guess chaos is what you are referring to. Stuff like the Lorentz attractor. In which case I would say that the point is not to predict one particular brain (in which case you would be right): any initial conditions would be fine as far as any brain gets started :) that is the goal :)
  •  
    Kurzweil talks about downloading your brain to a computer, so he has a specific brain in mind; Markram talks about identifying neural basis of mental diseases, so he has at least pretty specific situations in mind. Chaos is not the only problem, even a perfectly linear brain (which is not a biological brain) is not predictable, since one cannot determine a complete set of initial conditions of a working (viz. living) brain (after having determined about 10% the brain is dead and the data useless). But the situation is even worse: from all we know a brain will only work with a suitable interaction with its environment. So these boundary conditions one has to determine as well. This is already twice impossible. But the situation is worse again: from all we know, the way the brain interacts with its environment at a neural level depends on his history (how this brain learned). So your boundary conditions (that are impossible to determine) depend on your initial conditions (that are impossible to determine). Thus the situation is rather impossible squared than twice impossible. I'm sure Markram will simulate something, but this will rather be the famous Boltzmann brain than a biological one. Boltzman brains work with any initial conditions and any boundary conditions... and are pretty dead!
  •  
    Say one has an accurate model of a brain. It may be the case that the initial and boundary conditions do not matter that much in order for the brain to function an exhibit macro-characteristics useful to make science. Again, if it is not one particular brain you are targeting, but the 'brain' as a general entity this would make sense if one has an accurate model (also to identify the neural basis of mental diseases). But in my opinion, the construction of such a model of the brain is impossible using a reductionist approach (that is taking the naive approach of putting together some artificial neurons and connecting them in a huge net). That is why both Kurzweil and Markram are doomed to fail.
  •  
    I think that in principle some kind of artificial brain should be feasible. But making a brain by just throwing together a myriad of neurons is probably as promising as throwing together some copper pipes and a heap of silica and expecting it to make calculations for you. Like in the biological system, I suspect, an artificial brain would have to grow from a small tiny functional unit by adding neurons and complexity slowly and in a way that in a stable way increases the "usefulness"/fitness. Apparently our brain's usefulness has to do with interpreting inputs of our sensors to the world and steering the body making sure that those sensors, the brain and the rest of the body are still alive 10 seconds from now (thereby changing the world -> sensor inputs -> ...). So the artificial brain might need sensors and a body to affect the "world" creating a much larger feedback loop than the brain itself. One might argue that the complexity of the sensor inputs is the reason why the brain needs to be so complex in the first place. I never quite see from these "artificial brain" proposals in how far they are trying to simulate the whole system and not just the brain. Anyone? Or are they trying to simulate the human brain after it has been removed from the body? That might be somewhat easier I guess...
  •  
    Johannes: "I never quite see from these "artificial brain" proposals in how far they are trying to simulate the whole system and not just the brain." In Artificial Life the whole environment+bodies&brains is simulated. You have also the whole embodied cognition movement that basically advocates for just that: no true intelligence until you model the system in its entirety. And from that you then have people building robotic bodies, and getting their "brains" to learn from scratch how to control them, and through the bodies, the environment. Right now, this is obviously closer to the complexity of insect brains, than human ones. (my take on this is: yes, go ahead and build robots, if the intelligence you want to get in the end is to be displayed in interactions with the real physical world...) It's easy to dismiss Markram's Blue Brain for all their clever marketing pronouncements that they're building a human-level consciousness on a computer, but from what I read of the project, they seem to be developing a platfrom onto which any scientist can plug in their model of a detail of a detail of .... of the human brain, and get it to run together with everyone else's models of other tiny parts of the brain. This is not the same as getting the artificial brain to interact with the real world, but it's a big step in enabling scientists to study their own models on more realistic settings, in which the models' outputs get to effect many other systems, and throuh them feed back into its future inputs. So Blue Brain's biggest contribution might be in making model evaluation in neuroscience less wrong, and that doesn't seem like a bad thing. At some point the reductionist approach needs to start moving in the other direction.
  •  
    @ Dario: absolutely agree, the reductionist approach is the main mistake. My point: if you take the reductionsit approach, then you will face the initial and boundary value problem. If one tries a non-reductionist approach, this problem may be much weaker. But off the record: there exists a non-reductionist theory of the brain, it's called psychology... @ Johannes: also agree, the only way the reductionist approach could eventually be successful is to actually grow the brain. Start with essentially one neuron and grow the whole complexity. But if you want to do this, bring up a kid! A brain without body might be easier? Why do you expect that a brain detached from its complete input/output system actually still works. I'm pretty sure it does not!
  •  
    @Luzi: That was exactly my point :-)
jaihobah

Machine Learning's 'Amazing' Ability to Predict Chaos - 2 views

  •  
    Researchers have used machine learning to predict the chaotic evolution of a model flame front.
htoftevaag

Machine Learning for Accelerated and Inverse Metasurface Design - 0 views

  •  
    If you have 45 minutes and you want to learn a bit about inverse design of metasurfaces using machine learning, then I would highly recommend this talk. I found it very easy to follow both the physics and machine learning parts of it.
Dario Izzo

Detexify LaTeX handwritten symbol recognition - 2 views

  •  
    For hardcore latex users (btw ... implemented in haskell ... classical machine learning app, but useful)
  •  
    Also available as Android app (not sure if called "texify" or "detexify".
  •  
    works actually quite well!!
Thijs Versloot

Laser #fusion passes milestone #NIF - 1 views

  •  
    Machine breakeven reached at NIF, meaning 10kJ pushed into the pellet and a total output of17kJ. This is however a machine breakeven as it took several orders of magnitude more power to pump and fire 192 ns-lasers to achieve the input, but a tremendous achievement nonetheless after 60 years of fusion research
  •  
    and I think the actual paper might be this one: http://www.nature.com/nature/journal/vaop/ncurrent/full/nature13008.html
Guido de Croon

Will robots be smarter than humans by 2029? - 2 views

  •  
    Nice discussion about the singularity. Made me think of drinking coffee with Luis... It raises some issues such as the necessity of embodiment, etc.
  • ...9 more comments...
  •  
    "Kurzweilians"... LOL. Still not sold on embodiment, btw.
  •  
    The biggest problem with embodiment is that, since the passive walkers (with which it all started), it hasn't delivered anything really interesting...
  •  
    The problem with embodiment is that it's done wrong. Embodiment needs to be treated like big data. More sensors, more data, more processing. Just putting a computer in a robot with a camera and microphone is not embodiment.
  •  
    I like how he attacks Moore's Law. It always looks a bit naive to me if people start to (ab)use it to make their point. No strong opinion about embodiment.
  •  
    @Paul: How would embodiment be done RIGHT?
  •  
    Embodiment has some obvious advantages. For example, in the vision domain many hard problems become easy when you have a body with which you can take actions (like looking at an object you don't immediately recognize from a different angle) - a point already made by researchers such as Aloimonos.and Ballard in the end 80s / beginning 90s. However, embodiment goes further than gathering information and "mental" recognition. In this respect, the evolutionary robotics work by for example Beer is interesting, where an agent discriminates between diamonds and circles by avoiding one and catching the other, without there being a clear "moment" in which the recognition takes place. "Recognition" is a behavioral property there, for which embodiment is obviously important. With embodiment the effort for recognizing an object behaviorally can be divided between the brain and the body, resulting in less computation for the brain. Also the article "Behavioural Categorisation: Behaviour makes up for bad vision" is interesting in this respect. In the field of embodied cognitive science, some say that recognition is constituted by the activation of sensorimotor correlations. I wonder to which extent this is true, and if it is valid for extremely simple creatures to more advanced ones, but it is an interesting idea nonetheless. This being said, if "embodiment" implies having a physical body, then I would argue that it is not a necessary requirement for intelligence. "Situatedness", being able to take (virtual or real) "actions" that influence the "inputs", may be.
  •  
    @Paul While I completely agree about the "embodiment done wrong" (or at least "not exactly correct") part, what you say goes exactly against one of the major claims which are connected with the notion of embodiment (google for "representational bottleneck"). The fact is your brain does *not* have resources to deal with big data. The idea therefore is that it is the body what helps to deal with what to a computer scientist appears like "big data". Understanding how this happens is key. Whether it is the problem of scale or of actually understanding what happens should be quite conclusively shown by the outcomes of the Blue Brain project.
  •  
    Wouldn't one expect that to produce consciousness (even in a lower form) an approach resembling that of nature would be essential? All animals grow from a very simple initial state (just a few cells) and have only a very limited number of sensors AND processing units. This would allow for a fairly simple way to create simple neural networks and to start up stable neural excitation patterns. Over time as complexity of the body (sensors, processors, actuators) increases the system should be able to adapt in a continuous manner and increase its degree of self-awareness and consciousness. On the other hand, building a simulated brain that resembles (parts of) the human one in its final state seems to me like taking a person who is just dead and trying to restart the brain by means of electric shocks.
  •  
    Actually on a neuronal level all information gets processed. Not all of it makes it into "conscious" processing or attention. Whatever makes it into conscious processing is a highly reduced representation of the data you get. However that doesn't get lost. Basic, low processed data forms the basis of proprioception and reflexes. Every step you take is a macro command your brain issues to the intricate sensory-motor system that puts your legs in motion by actuating every muscle and correcting every step deviation from its desired trajectory using the complicated system of nerve endings and motor commands. Reflexes which were build over the years, as those massive amounts of data slowly get integrated into the nervous system and the the incipient parts of the brain. But without all those sensors scattered throughout the body, all the little inputs in massive amounts that slowly get filtered through, you would not be able to experience your body, and experience the world. Every concept that you conjure up from your mind is a sort of loose association of your sensorimotor input. How can a robot understand the concept of a strawberry if all it can perceive of it is its shape and color and maybe the sound that it makes as it gets squished? How can you understand the "abstract" notion of strawberry without the incredibly sensible tactile feel, without the act of ripping off the stem, without the motor action of taking it to our mouths, without its texture and taste? When we as humans summon the strawberry thought, all of these concepts and ideas converge (distributed throughout the neurons in our minds) to form this abstract concept formed out of all of these many many correlations. A robot with no touch, no taste, no delicate articulate motions, no "serious" way to interact with and perceive its environment, no massive flow of information from which to chose and and reduce, will never attain human level intelligence. That's point 1. Point 2 is that mere pattern recogn
  •  
    All information *that gets processed* gets processed but now we arrived at a tautology. The whole problem is ultimately nobody knows what gets processed (not to mention how). In fact an absolute statement "all information" gets processed is very easy to dismiss because the characteristics of our sensors are such that a lot of information is filtered out already at the input level (e.g. eyes). I'm not saying it's not a valid and even interesting assumption, but it's still just an assumption and the next step is to explore scientifically where it leads you. And until you show its superiority experimentally it's as good as all other alternative assumptions you can make. I only wanted to point out is that "more processing" is not exactly compatible with some of the fundamental assumptions of the embodiment. I recommend Wilson, 2002 as a crash course.
  •  
    These deal with different things in human intelligence. One is the depth of the intelligence (how much of the bigger picture can you see, how abstract can you form concept and ideas), another is the breadth of the intelligence (how well can you actually generalize, how encompassing those concepts are and what is the level of detail in which you perceive all the information you have) and another is the relevance of the information (this is where the embodiment comes in. What you do is to a purpose, tied into the environment and ultimately linked to survival). As far as I see it, these form the pillars of human intelligence, and of the intelligence of biological beings. They are quite contradictory to each other mainly due to physical constraints (such as for example energy usage, and training time). "More processing" is not exactly compatible with some aspects of embodiment, but it is important for human level intelligence. Embodiment is necessary for establishing an environmental context of actions, a constraint space if you will, failure of human minds (i.e. schizophrenia) is ultimately a failure of perceived embodiment. What we do know is that we perform a lot of compression and a lot of integration on a lot of data in an environmental coupling. Imo, take any of these parts out, and you cannot attain human+ intelligence. Vary the quantities and you'll obtain different manifestations of intelligence, from cockroach to cat to google to random quake bot. Increase them all beyond human levels and you're on your way towards the singularity.
LeopoldS

The edge of the abyss: exposing the NSA's all-seeing machine | The Verge - 0 views

  •  
    nice summary overview
Thijs Versloot

Time 'Emerges' from #Quantum Entanglement #arXiv - 1 views

  •  
    Time is an emergent phenomenon that is a side effect of quantum entanglement, say physicists. And they have the first exprimental results to prove it
  • ...5 more comments...
  •  
    I always feel like people make too big a deal out of entanglement. In my opinion it is just a combination of a conserved quantity and an initial lack of knowledge. Imagine that I had a machine that always creates one blue and one red ping-pong ball at the same time (|b > and |r > respectively). The machine now puts both balls into identical packages (so I cannot observe them) and one of the packages is sent to Tokio. I did not know which ball was sent to Tokio and which stayed with me - they are in a superposition (|br >+|rb >), meaning that either the blue ball is with me and the red one in Tokio or vice versa - they are entangled. So far no magic has happened. Now I call my friend in Tokio who got the ball: "What color was the ball you received in that package?" He replies: "The ball that I got was blue. Why did you send me ball in the first place?" Now, the fact that he told me makes the superpositon wavefunction collapse (yes, that is what the Copenhagen interpretation would tell us). As a result I know without opening my box that it contains a red ball. But this is really because there is an underlying conservation law and because now I know the other state. I don't see how just looking at the conserved quantity I am in a timeless state outside of the 'universe' - this is just one way of interpreting it. By the way, the wave function for my box with the undetermined ball does not collapse when the other ball is observed by my friend in Tokio. Only when he tells me does the wavefunction collapse - he did not even know that I had a complementary ball. On the other hand if he knew about the way the experiment was conducted then he would have known that I had to have a red ball - the wavefunction collapses as soon as he observed his ball. For him it is determined that my ball must be red. For me however the superposition is intact until he tells me. ;-)
  •  
    Sorry, Johannes, you just develop a simple hidden-parameters theory and it's experimentally proven that these don't work. Entangeled states are neither the blue nor the red ball they are really bluered (or redblue) till the point the measurement is done.
  •  
    Hm, to me this looks like a bad joke... The "emergent time" concept used is still the old proposal by Page and Whotters where time emerges from something fundamentally unobservable (the wave function of the Universe). That's as good as claiming that time emerges from God. If I understand correctly, the paper now deals with the situation where a finite system is taken as "Mini-Universe" and the experimentalist in the lab can play "God of the Mini-Universe". This works, of course, but it doesn't really tell us anything about emergent time, does it?
  •  
    Actually, it has not been proven conclusively that hidden variable theories don' work - although this is the opinion of most physicists these days. But a non-local hidden variable would still be allowed - I don't see why that could not be equivalent to a conserved quantity within the system. As far as the two balls go it is fine to say they are undetermined instead of saying they are in bluered or redblue state - for all intents and purposes it does not affect us (because if it would the wavefunction would have collapsed) so we can't say anything about it in the first place.
  •  
    Non-local hidden variables may work, but in my opinion they don't add anything to the picture. The (at least to non-physicists) contraintuitive fact that there cannot be a variable that determines ab initio the color of the ball going to Tokio will remain (in your example this may not even be true since the example is too simple...).
  •  
    I guess I tentatively agree with you on both points. In the end there might anyway be surprisingly little overlap between the way that we describe what nature does and HOW it does it... :-D
  •  
    Congratulations! 100% agree.
LeopoldS

Investigating Machine Identification Code Technology in Color Laser Printers | Electron... - 0 views

  •  
    I assume that our fancy colour printer also have this "feature" ... 
1 - 20 of 115 Next › Last »
Showing 20 items per page