Supernovae

Yoo someone actually send me a gift Lmaoo sank u ❤️‍🔥

Nova and her cat is at your door with a New Year song for you. መልካም አዲስ አመት! Let’s see how many of are generous lol 😂

Attention in Transformers Quick version:

each word gets turned into a vector, a long list of numbers, where different directions in the space can carry meaning. But at the start, the representation is mostly about the token itself. “Mole” is the same token whether you’re talking about the animal, the chemistry unit, or the thing on your skin.

Attention is what lets that representation become contextual. Every token sends out a query what am I looking for? and a key what information do I offer? Match them up, softmax the scores into weights, and each token pulls in a weighted mix of everyone else’s values. So the representation of a token can change depending on what’s around it. Sooo cool part attention has no idea what order the words are in. It’s basically doing weighted combinations, and addition doesn’t care about sequence. “The dog bit the man” and “the man bit the dog” would look the same to attention if you gave it the same token representations without any positional information. Position has to be added separately so the model knows where things are. I’d read about transformers plenty of times and somehow never registered that. Also, the title is kinda wrong. Attention isn’t all you need. In GPT-3, roughly a third of the parameters are in the attention mechanism; a lot of the rest sits in the layers between the attention blocks. And apparently those layers are doing a lot more than I initially thought including storing some of the model’s learned knowledge. Attention moves information around. Something else is doing a lot of the processing. I haven’t implemented it yet, which means I only half know this.

Day 3 topic is so interesting and kinda difficult at the same time I can wait for u guys to check the papers and the videos 1 is from our obv 3blue1brown

She ain’t exist in this universe. She is fake her

This is lmaoo 😂

Epigenetics Every cell in your body has essentially the same DNA.

A neuron and a liver cell are working with the same genetic information, but they look and behave completely differently. So something has to determine which instructions each cell actually reads.

epigenome comes ...and

chemical modifications and changes in how DNA is packaged that help regulate which genes are active, without changing the underlying DNA sequence itself.

And this is where I started wondering about lifestyle... sooooo Things like diet, exercise, stress, sleep, smoking, environmental exposures, and even aging can create signals inside the body that influence how cells function, and some of those processes can involve epigenetic changes. So it’s not really.... From what I've read lol

lifestyle → rewrites your DNA

It’s more like:

environment/lifestyle → signals in your cells → changes in gene regulation → changes in which genes are expressed → changes in how cells function

Which is actually way more interesting to me. Your DNA isn’t just a fixed script that runs exactly the same way your entire life. The way your cells use that script can change.... I went into this expecting to learn how your grandmother’s hardships get written into your DNA….Everyone repeats that one. I assumed I’d spend the night reading about the mechanism. Instead, I ended up finding geneticists taking some of those studies apart…😭 No biology related stuff Fr so confused I've read not 5 pages but so many paper lol 😂 and videos Fr will drop it [ me still confused )love it

Okay so I watched a lecture on systems thinking a while back and it's been living in my head since It basically gave me names for ways I'd already been thinking about things without realizing the ways had names.But on this one learned some new stuff fr Reductionism

if something's complicated, break it into parts. Body → organs → cells → molecules → atoms. Wildly successful in science. But there's a catch: knowing what every component of a computer does doesn't tell you what happens when they're all running at once. The relationships between the parts start mattering too.

Cartesian dualism

Descartes splitting the world in two: physical stuff on one side (bodies, objects), mental stuff on the other (thoughts, experience). Which immediately opens the annoying question — how does something physical, like a brain, produce something subjective, like a thought?

Emergence

this is the one that got me. A property that shows up at the level of the whole but doesn't exist in any part on its own. One neuron doesn't have a memory. Billions of them interacting somehow do. Individual air and water molecules aren't a hurricane, but enough of them under the right conditions and suddenly there's this huge organized thing with a name and a track. So where does the new property actually live? Not inside any single part. It's in the interactions.

Systems thinking

instead of only asking "what are the parts," you also ask "how are they connected, and what happens because of that." A tree isn't just cells and roots and leaves, it's also sunlight, soil, fungi, insects, the whole environment around it. Pull it out of all that and study it alone and you learn real things just not the whole picture.

The way it stacks up reductionism explains the parts, systems thinking explains the relationships, emergence explains how relationships produce something new. It keeps going into consciousness, complexity, self-organization, chaos, cybernetics, even panpsychism.((

Panpsychism is the view that consciousness or something proto-conscious, some minimal form of experience is a fundamental and ubiquitous feature of physical reality, present in some degree in all matter rather than appearing only in brains

Asp t you also start wondering what counts as a "thing" in the first place, which I was not prepared for on a random weekday (gotta share it somewhere )

China made this ;)

Is it me or y’all also think about buying an ice cream on payday lmaoo 😭

🌻🌻

I wanted to start simple btw

The Ship of Theseus is one of those paradoxes everyone has heard of, and I'm pretty sure I've mentioned it before. But last night I actually sat down to read about it properly, and I went way deeper than I planned to .. The setup is simple. You have a ship. Over the years you replace every part of it, one at a time, until none of the original pieces are left. Is it still the same ship? Then it gets better. Say someone kept all the old parts and built a second ship out of them. Now there are two ships, and both have a decent claim to being the original. They can't both be it. What got me is that this was never really about ships. It's asking what makes anything the same thing over time when everything about it has changed. Which obviously gets uncomfortable fast when you turn it on yourself. My cells have been replaced. My beliefs have changed. Half my memories are gone or rewritten. So what exactly is doing the work of making me the same person as the kid in my old photos? I did a a bit research reading abt identity, the self, and the different answers philosophers have given. Some of them dissolve the question entirely by arguing there is no ship, only planks arranged ship-wise. There's a lot more here than I expected. This is Day 1 .... I was hoping for vm but not today lol Will share the Resources I used also

focus on this 😉

And films as well :)