Modern neural network writing Ponies · 5:25pm Aug 31st, 2019
I've been playing with Talk to Transformer, which promises to let the user "See how a modern neural network completes your text."
I entered the first few lines from Teatime - A Novel Of Twilight & Celestia. The results are not quite CelestiaAI level, but it is pretty cool.
"Spike, I miss Princess Celestia.”
Twilight Sparkle slumped in her favorite big chair, before a broad oaken desk. Floor to ceiling bookcases flanked the desk. Plum colored floors, cobalt walls, and organic sapphire pillars cast her castle office in cool tones.
Spike threw Twilight a quizzical look. “But, you saw Princess Celestia just last week, and the week before that.”
“Those meetings were for work.” Twilight rustled her wings and fidgeted to try and get comfortable in the chair. “Last week was to deliver my plans for next year’s Young Leaders Summit. And the week before that was an emergency meeting with her and Princess Luna about the return of the Tantabus.
“What I mean is, I miss my old relationship with Princess Celestia.”
And here are a couple of follow on lines generated by a version of OpenAI's new machine learning language model called GPT-2 that generates coherent paragraphs of text one word at a time.
Twilight looked over at Spike and then glanced at the ceiling for a moment. Her face softened. “She's just not there in the same way anymore.’
Spike continued to stare at his partner, his expression seeming resigned
The results are not bad. Admittedly, it was the best of the four times I tried it. But I would be interested to see what the full model could do.
One author suggested using Talk to Transformer as an inspiration machine when you have writers block. Enter a couple of lines from your current story and see where the AI takes the story next. If the results sing to you, then you can write more from there.
Huh. That is really cool!