Techኢት
Welcome to Techኢት Channel! Your tech news hub. Explore daily tech news and don't miss our weekly audio podcast. Join: https://t.me/Techeth_Discussion_Group Youttube: https://www.youtube.com/@Techinethio Contact Us: @muhammednoorr @icon_dura
Більше- Підписники
- Перегляди допису
- ER - коефіцієнт залучення
Триває завантаження даних...
Триває завантаження даних...
*Data Structures and Algorithms🌑“Smart data structures and dumb code works a lot better than the other way around.” — Eric S. Raymond
*Version Control🌑“It is easy to shoot your foot off with git, but also easy to revert to a previous foot and merge it with your current leg.” — Jack William Bell
*Testing and Debugging🌑“If you don’t like testing your product, most likely your customers won’t like to test it either.” — Anonymous
*Security Awareness🌑“It takes 20 years to build a reputation and few minutes of cyber-incident to ruin it.” — Stephane Nappo
*Soft Skills and Collaboration🌑Chris Pine: “Programming isn’t about what you know; it’s about what you can figure out.” @techinethio #SoftSkill #DSA #versionControl #TestingandDebugging
MIT neuroscientists have found reading computer code does not rely on the regions of the brain involved in language processing. Instead, it activates the “multiple demand network,” which is also recruited for complex cognitive tasks such as solving math problems or crossword puzzles.
What are the neurons, why are there layers, and what is the math underlying it? Help fund future projects:
https://www.patreon.com/3blue1brownWritten/interactive form of this series:
https://www.3blue1brown.com/topics/neural-networksAdditional funding for this project provided by Amplify Partners Typo correction: At 14 minutes 45 seconds, the last index on the bias vector is n, when it's supposed to in fact be a k. Thanks for the sharp eyes that caught that! For those who want to learn more, I highly recommend the book by Michael Nielsen introducing neural networks and deep learning:
https://goo.gl/ZmczdyThere are two neat things about this book. First, it's available for free, so consider joining me in making a donation Nielsen's way if you get something out of it. And second, it's centered around walking through some code and data which you can download yourself, and which covers the same example that I introduce in this video. Yay for active learning!
https://github.com/mnielsen/neural-networks-and-deep-learningI also highly recommend Chris Olah's blog: http://colah.github.io/ For more videos, Welch Labs also has some great series on machine learning:
https://youtu.be/i8D90DkCLhIhttps://youtu.be/bxe2T-V8XRs
For those of you looking to go *even* deeper, check out the text "Deep Learning" by Goodfellow, Bengio, and Courville. Also, the publication Distill is just utterly beautiful:
https://distill.pub/Lion photo by Kevin Pluck Thanks to these viewers for their contributions to translations German: @fpgro Hebrew: Omer Tuchfeld Hungarian: Máté Kaszap Italian: @teobucci, Teo Bucci ----------------- Timeline: 0:00 - Introduction example 1:07 - Series preview 2:42 - What are neurons? 3:35 - Introducing layers 5:31 - Why layers? 8:38 - Edge detection example 11:34 - Counting weights and biases 12:30 - How learning relates 13:26 - Notation and linear algebra 15:17 - Recap 16:27 - Some final words 17:03 - ReLU vs Sigmoid Correction 14:45 - The final index on the bias vector should be "k" ------------------ Animations largely made using manim, a scrappy open source python library.
https://github.com/3b1b/manimIf you want to check it out, I feel compelled to warn you that it's not the most well-documented tool, and has many other quirks you might expect in a library someone wrote with only their own use in mind. Music by Vincent Rubinetti. Download the music on Bandcamp:
https://vincerubinetti.bandcamp.com/album/the-music-of-3blue1brownStream the music on Spotify:
https://open.spotify.com/album/1dVyjwS8FBqXhRunaG5W5uIf you want to contribute translated subtitles or to help review those that have already been made by others and need approval, you can click the gear icon in the video and go to subtitles/cc, then "add subtitles/cc". I really appreciate those who do this, as it helps make the lessons accessible to more people. ------------------ 3blue1brown is a channel about animating math, in all senses of the word animate. And you know the drill with YouTube, if you want to stay posted on new videos, subscribe, and click the bell to receive notifications (if you're into that). If you are new to this channel and want to see more, a good place to start is this playlist: http://3b1b.co/recommended Various social media stuffs: Website:
https://www.3blue1brown.comTwitter:
https://twitter.com/3Blue1BrownPatreon:
https://patreon.com/3blue1brownFacebook:
https://www.facebook.com/3blue1brownReddit:
https://www.reddit.com/r/3Blue1BrownThis is heaven for visual learnershttps://youtu.be/wjZofJX0v4M?si=a2c60ZdsB0FE5Vmr
Unpacking how large language models work under the hood Early view of the next chapter for patrons:
https://3b1b.co/early-attentionSpecial thanks to these supporters:
https://3b1b.co/lessons/gpt#thanksTo contribute edits to the subtitles, visit
https://translate.3blue1brown.com/Other recommended resources on the topic. Richard Turner's introduction is one of the best starting places:
https://arxiv.org/pdf/2304.10557.pdfCoding a GPT with Andrej Karpathy
https://youtu.be/kCc8FmEb1nYIntroduction to self-attention by John Hewitt
https://web.stanford.edu/class/cs224n/readings/cs224n-self-attention-transformers-2023_draft.pdfHistory of language models by Brit Cruise:
https://youtu.be/OFS90-FX6pgPaper about examples like the “woman - man” one presented here:
https://arxiv.org/pdf/1301.3781.pdf------------------ Timestamps 0:00 - Predict, sample, repeat 3:03 - Inside a transformer 6:36 - Chapter layout 7:20 - The premise of Deep Learning 12:27 - Word embeddings 18:25 - Embeddings beyond words 20:22 - Unembedding 22:22 - Softmax with temperature 26:03 - Up next ------------------ These animations are largely made using a custom Python library, manim. See the FAQ comments here:
https://3b1b.co/faq#manimhttps://github.com/3b1b/manim
https://github.com/ManimCommunity/manim/
All code for specific videos is visible here:
https://github.com/3b1b/videos/The music is by Vincent Rubinetti.
https://www.vincentrubinetti.comhttps://vincerubinetti.bandcamp.com/album/the-music-of-3blue1brown
https://open.spotify.com/album/1dVyjwS8FBqXhRunaG5W5u
------------------ 3blue1brown is a channel about animating math, in all senses of the word animate. If you're reading the bottom of a video description, I'm guessing you're more interested than the average viewer in lessons here. It would mean a lot to me if you chose to stay up to date on new ones, either by subscribing here on YouTube or otherwise following on whichever platform below you check most regularly. Mailing list:
https://3blue1brown.substack.comTwitter:
https://twitter.com/3blue1brownInstagram:
https://www.instagram.com/3blue1brownReddit:
https://www.reddit.com/r/3blue1brownFacebook:
https://www.facebook.com/3blue1brownPatreon:
https://patreon.com/3blue1brownWebsite:
https://www.3blue1brown.comThe Next.js 15 Release Candidate (RC) is now available. This early version allows you to test the latest features before the upcoming stable release.