Hey Chat , It Appears I Need Someone To Yell At Me To Write

AO3'S content scraped for AI ~ AKA what is generative AI, where did your fanfictions go, and how an AI model uses them to answer prompts

Generative artificial intelligence is a cutting-edge technology whose purpose is to (surprise surprise) generate. Answers to questions, usually. And content. Articles, reviews, poems, fanfictions, and more, quickly and with originality.

It's quite interesting to use generative artificial intelligence, but it can also become quite dangerous and very unethical to use it in certain ways, especially if you don't know how it works.

With this post, I'd really like to give you a quick understanding of how these models work and what it means to “train” them.

From now on, whenever I write model, think of ChatGPT, Gemini, Bloom... or your favorite model. That is, the place where you go to generate content.

For simplicity, in this post I will talk about written content. But the same process is used to generate any type of content.

Every time you send a prompt, which is a request sent in natural language (i.e., human language), the model does not understand it.

Whether you type it in the chat or say it out loud, it needs to be translated into something understandable for the model first.

The first process that takes place is therefore tokenization: breaking the prompt down into small tokens. These tokens are small units of text, and they don't necessarily correspond to a full word.

For example, a tokenization might look like this:

Write a story

Each different color corresponds to a token, and these tokens have absolutely no meaning for the model.

The model does not understand them. It does not understand WR, it does not understand ITE, and it certainly does not understand the meaning of the word WRITE.

In fact, these tokens are immediately associated with numerical values, and each of these colored tokens actually corresponds to a series of numbers.

Write a story 12-3446-2638494-4749

Once your prompt has been tokenized in its entirety, that tokenization is used as a conceptual map to navigate within a vector database.

NOW PAY ATTENTION: A vector database is like a cube. A cubic box.

Inside this cube, the various tokens exist as floating pieces, as if gravity did not exist. The distance between one token and another within this database is measured by arrows called, indeed, vectors.

The distance between one token and another -that is, the length of this arrow- determines how likely (or unlikely) it is that those two tokens will occur consecutively in a piece of natural language discourse.

For example, suppose your prompt is this:

It happens once in a blue

Within this well-constructed vector database, let's assume that the token corresponding to ONCE (let's pretend it is associated with the number 467) is located here:

The token corresponding to IN is located here:

...more or less, because it is very likely that these two tokens in a natural language such as human speech in English will occur consecutively.

So it is very likely that somewhere in the vector database cube —in this yellow corner— are tokens corresponding to IT, HAPPENS, ONCE, IN, A, BLUE... and right next to them, there will be MOON.

Elsewhere, in a much more distant part of the vector database, is the token for CAR. Because it is very unlikely that someone would say It happens once in a blue car.

To generate the response to your prompt, the model makes a probabilistic calculation, seeing how close the tokens are and which token would be most likely to come next in human language (in this specific case, English.)

When probability is involved, there is always an element of randomness, of course, which means that the answers will not always be the same.

The response is thus generated token by token, following this path of probability arrows, optimizing the distance within the vector database.

There is no intent, only a more or less probable path.

The more times you generate a response, the more paths you encounter. If you could do this an infinite number of times, at least once the model would respond: "It happens once in a blue car!"

So it all depends on what's inside the cube, how it was built, and how much distance was put between one token and another.

Modern artificial intelligence draws from vast databases, which are normally filled with all the knowledge that humans have poured into the internet.

Not only that: the larger the vector database, the lower the chance of error. If I used only a single book as a database, the idiom "It happens once in a blue moon" might not appear, and therefore not be recognized.

But if the cube contained all the books ever written by humanity, everything would change, because the idiom would appear many more times, and it would be very likely for those tokens to occur close together.

Huggingface has done this.

It took a relatively empty cube (let's say filled with common language, and likely many idioms, dictionaries, poetry...) and poured all of the AO3 fanfictions it could reach into it.

Now imagine someone asking a model based on Huggingface’s cube to write a story.

To simplify: if they ask for humor, we’ll end up in the area where funny jokes or humor tags are most likely. If they ask for romance, we’ll end up where the word kiss is most frequent.

And if we’re super lucky, the model might follow a path that brings it to some amazing line a particular author wrote, and it will echo it back word for word.

(Remember the infinite monkeys typing? One of them eventually writes all of Shakespeare, purely by chance!)

Once you know this, you’ll understand why AI can never truly generate content on the level of a human who chooses their words.

You’ll understand why it rarely uses specific words, why it stays vague, and why it leans on the most common metaphors and scenes. And you'll understand why the more content you generate, the more it seems to "learn."

It doesn't learn. It moves around tokens based on what you ask, how you ask it, and how it tokenizes your prompt.

Know that I despise generative AI when it's used for creativity. I despise that they stole something from a fandom, something that works just like a gift culture, to make money off of it.

But there is only one way we can fight back: by not using it to generate creative stuff.

You can resist by refusing the model's casual output, by using only and exclusively your intent, your personal choice of words, knowing that you and only you decided them.

No randomness involved.

Let me leave you with one last thought.

Imagine a person coming for advice, who has no idea that behind a language model there is just a huge cube of floating tokens predicting the next likely word.

Imagine someone fragile (emotionally, spiritually...) who begins to believe that the model is sentient. Who has a growing feeling that this model understands, comprehends, when in reality it approaches and reorganizes its way around tokens in a cube based on what it is told.

A fragile person begins to empathize, to feel connected to the model.

They ask important questions. They base their relationships, their life, everything, on conversations generated by a model that merely rearranges tokens based on probability.

And for people who don't know how it works, and because natural language usually does have feeling, the illusion that the model feels is very strong.

There’s an even greater danger: with enough random generations (and oh, the humanity whole generates much), the model takes an unlikely path once in a while. It ends up at the other end of the cube, it hallucinates.

Errors and inaccuracies caused by language models are called hallucinations precisely because they are presented as if they were facts, with the same conviction.

People who have become so emotionally attached to these conversations, seeing the language model as a guru, a deity, a psychologist, will do what the language model tells them to do or follow its advice.

Someone might follow a hallucinated piece of advice.

Obviously, models are developed with safeguards; fences the model can't jump over. They won't tell you certain things, they won't tell you to do terrible things.

Yet, there are people basing major life decisions on conversations generated purely by probability.

Generated by putting tokens together, on a probabilistic basis.

Think about it.

WHAT THE FLIP MAN THE BEST TASTING ONE IS CLEARLY THAT PEACH SCENTED ONE FROM THE ASIAN STORE DEAR GOD HAVE SOME TASTE

Hot take:

Sharpies taste better then Crayola markers

Good morning!! Don’t mind me giving an ask literally less than ten min after you posted lmao—

Very intrigued by your post-tahiti cal & daisy dynamic, I like that he’s still in her life even after all… that that was s2.

I’m more curious about why daisy decided to run away after the whole hive debacle? Was it for the same reasons as in canon?

Also, the last dot point also rose a mental flag in my angst-infested brain — does daisy ever mistake cal for coulson when she’s sick?

First of all, as always, hi Anon! I do not mind you asking me so soon— I love it when people talk to me so this is awesome.

YES SOMEONE ASKED ME ABOUT WHY SHE RAN AWAY FINALLY HAHA!!! I have dialogue written. It wouldn’t have seen the light of day if not for you. Thank you. Thank you so much.

As for your last question, Daisy never mistakes Cal for Coulson. She drew a line between them a long time ago, and she never crosses it, not even by mistake. The reason she rambles is that her brain knows that she trusts Cal. She just… doesn’t remember why she didn’t tell him before. So she then tells him everything that she can think of. She also has a habit of calling him ‘Doc’ and he finds it very endearing.

ONTO THE MAIN EVENT!!!! ITS SUPER DIALOGUE HEAVY IM SORRY BUT VOILA HAVE IT. IT ALSO HAS SOME CONSISTENCY MISTAKES BUT. IGNORE THAT. ILL FIX IT IN A LATER POST.

—

(Post season 3 finale.)

(In Daisy’s room.)

The room felt empty. Her mother and she were inside, but it felt empty. Since Daisy got her powers, everywhere had this sort of buzz, with the volume of it increasing with the number of people around her. The room was quiet. Lincoln’s absence haunted it.

“I think…” Daisy’s voice sounded foreign to herself. “I think it hurts more because I thought we could’ve had something.”

May understood. She always did. “Like what?” her mother asked gently.

“I don’t know,” Daisy admitted. “A future, maybe. I had this thought that maybe after all this was over, we would come home and have a drink and laugh about that time we almost died. Maybe even a life outside of SHIELD. But I…”

“Mm.”

“Last night, I had this dream.”

A beat.

“What did you dream?”

“It was just a regular day. A chill one. No ops, no paperwork, just the kind of day that we could do regular things. Me and him, we had lunch and we sparred and just… spent the day together. We went to sleep and he was next to me, but when I woke up, he wasn’t. For a minute, I let myself think that he just got up early and went to the bathroom or to get us breakfast. I laid there for an hour, pretending that he wasn’t really gone, that he’d be back any minute with a smile or food or anything. I just wanted…”

“Him.”

“Yeah.” Daisy stared at her hands. They blurred as her eyes welled. She didn’t like that. “I don’t think I can stay here anymore. Everything reminds me of him and it hurts. So much. Every hallway, every room, even the cells, they… I just can’t be here anymore.”

“So don’t.”

“What?”

“Don’t be here. Take a little time to yourself. No one’s going to blame you. Not even if you never come back.”

“But…”

“We’ll survive without you. We’ll miss you, but we’ll survive.” May squeezed Daisy’s hands gently. “Phil’s going to relegitimize the agency. He’s handing over the reigns to the government.”

That got her attention. “What?”

“He’s stepping down as a director. This time next month, he’ll be a field agent just like you and me. We’ll get to pick our own assignments. The three of us, we can stick together. Just like old days.”

As much as she wanted to… “I can’t.”

“I understand. We’ll keep your room locked.”

“I might not come back.”

“I know. But just in case. You never know.”

“I’m sorry, Mom.”

“It’s okay. Just promise me you’ll take care of yourself out there.”

“Promise.”

Daisy lied as easily as breathing, these days.

RAHHHHH GO HAYATO GOOOOOO

its up

rah

go hayato goooo

I totally forgot I had this chapter done lmao. So before I fuck off for a bit enjoy the 3rd Chapter of my SemiShira fic, "Delusions of Grandeur."

To all the people who follow me for marvel stuff,

I am so sorry. I am so so so sorry. I’ve abandoned you and I am going to continue to abandon you until someone requests something that seems relatively easy to write.

Until next time,

Viie

(PS. This is totally the cue for yall to request stuff. I can’t promise I’ll get to it but please do and maybe I’ll pick something up.)

My first May fic for May!

AHAHAHAHAHAHAHAHHAHAH— *dies*

*banging my pots and pans* COMEREEEEE. SEMISHIRA FIC JUST GOT POSTEDDDDD. TIME FOR DIN DIN EVERYONE.

If you had this far planned , may I request what you had for May shooting Daisy when she was infected by Hive ?

I honestly forgot that happened.

I’m supposed to be doing my homework right now! What am I doing? Not my homework. Anyways, listen up fam I have a new fic idea. Got it while I was staring at a beautiful photo of onigiri.

Picture this— Daichi and his four younger siblings, suddenly orphaned during his last year of high school, with his graduation just around the corner. Daichi, now his siblings’ legal guardian, has to drop moving out to go to university with Suga, has to put a hold on his own dreams, to take care of his siblings. He has to do all of this while navigating more grief than his siblings, since he had the most time with their parents— the rest of them didn’t have their parents around as often, Daichi was the “test child” and was more of a parent to the rest of his siblings anyway— and he has to be careful what feelings he show because the second oldest hasn’t started high school yet, and the youngest is six.

Enter Suga: he was expecting his best friend of three years to be going to university with him. They’d planned this for a while now, from which university they were going to attend to which dorm they were going to stay. He doesn’t expect the change. He’s also reasonably distraught at the death of a pair of parents that he loved. He lashes out at Daichi, and Daichi yells back, but in the end, they decide this—

Whatever they do, they do it together. It’ll have its hardships; Daichi’s parents literally just died. But Suga is there to help, and Daichi will never say no to him.