Better Language Models and Their Implications - 1 views
-
mkisantal on 15 Feb 19Just read some of the samples of text generated with their neural networks, insane.
- ...3 more comments...
-
mkisantal on 15 Feb 19"Pérez and his friends were astonished to see the unicorn herd. These creatures could be seen from the air without having to move too much to see them - they were so close they could touch their horns. While examining these bizarre creatures the scientists discovered that the creatures also spoke some fairly regular English. Pérez stated, "We can see, for example, that they have a common 'language,' something like a dialect or dialectic."
-
Marcus Maertens on 15 Feb 19Shocking. I assume that this could indeed have severe implications if it gets in the "wrong hands".
-
marliesarnhof on 18 Feb 19"Feed it the first few paragraphs of a Guardian story about Brexit, and its output is plausible newspaper prose, replete with "quotes" from Jeremy Corbyn, mentions of the Irish border, and answers from the prime minister's spokesman." https://www.youtube.com/watch?time_continue=37&v=XMJ8VxgUzTc "Feed it the opening line of George Orwell's Nineteen Eighty-Four - "It was a bright cold day in April, and the clocks were striking thirteen" - and the system recognises the vaguely futuristic tone and the novelistic style, and continues with: "I was in my car on my way to a new job in Seattle. I put the gas in, put the key in, and then I let it run. I just imagined what the day would be like. A hundred years from now. In 2045, I was a teacher in some school in a poor part of rural China. I started with Chinese history and history of science." (https://www.theguardian.com/technology/2019/feb/14/elon-musk-backed-ai-writes-convincing-news-fiction)
-
marliesarnhof on 18 Feb 19It's really lucky that it was OpenAI who made that development and Elon Musk is so worried about AI. This way at least they try to assess the whole spectrum of abilities and applications of this model before releasing the full research to the public.
-
mkisantal on 18 Feb 19They released a smaller model, I got it running on Sandy. It's fairly straight forward: https://github.com/openai/gpt-2