#mlnews #llama2 #openai
Your regular irregular update on the world of Machine Learning.
References:
This is huge: Llama-v2 is open source, with a license that authorizes commercial use!
This is going to change the landscape of the LLM market.
Llama-v2 is available on Microsoft Azure and will be available on AWS, Hugging Face and other providersPretrained and fine-tuned…
— Yann LeCun (@ylecun) July 18, 2023
https://ai.meta.com/llama/
This Is the Biggest Social Media Platform: Ranking the World’s Largest Networking Sites
https://github.com/Alpha-VLLM/LLaMA2-Accessory
https://together.ai/blog/llama-2-7b-32k?s=09&utm_source=pocket_saves
https://github.com/imoneoi/openchat
Excited to release our latest Vicuna v1.5 series, featuring 4K and 16K context lengths with improved performance on almost all benchmarks!
Vicuna v1.5 is based on the commercial-friendly Llama 2 and has extended context length via positional interpolation.Since its release,… pic.twitter.com/6MW9YyRWf7
— lmarena.ai (formerly lmsys.org) (@lmarena_ai) August 2, 2023
https://huggingface.co/lmsys/vicuna-13b-v1.5-16k
https://blog.google/outreach-initiatives/public-policy/google-microsoft-openai-anthropic-frontier-model-forum/
https://www.earthdata.nasa.gov/news/impact-ibm-hls-foundation-model?utm_source=pocket_reader
https://huggingface.co/ibm-nasa-geospatial/Prithvi-100M
https://ai.meta.com/blog/generative-ai-text-images-cm3leon/
https://www.deepmind.com/blog/rt-2-new-model-translates-vision-and-language-into-action?utm_source=twitter&utm_medium=social&utm_campaign=rt2
https://arxiv.org/abs/2307.14334
https://sites.research.google/med-palm/
https://open-catalyst.metademolab.com/?utm_source=twitter&utm_medium=organic_social&utm_campaign=opencatalyst&utm_content=card
https://open-catalyst.metademolab.com/demo
https://www.anthropic.com/index/claude-2?utm_source=pocket_reader
https://claude.ai/login
https://audiocraft.metademolab.com/?utm_source=pocket_saves
Stability AI launches StableCode, an LLM for code generation
https://stability.ai/blog/stablecode-llm-generative-ai-coding
The Open Buildings V3 dataset of 1.8B building detections w/higher precision & recall is now available from@GoogleResearch, adding coverage for Latin America and the Caribbean (in addition to coverage of Africa and South and Southeast Asia from V1/V2).https://t.co/CyPStYdH51 pic.twitter.com/QuslyhlKmd
— Jeff Dean (@JeffDean) August 2, 2023
https://sites.research.google/open-buildings/
“Affordable RLHF for all” ❤️
It’s almost like an openly rebellious group at MSR have decided to subvert Microsoft’s investments in ClosedAI.https://t.co/znbMymeZiN pic.twitter.com/a5P1OegXv9
— Delip Rao e/σ (@deliprao) August 4, 2023
https://arxiv.org/pdf/2308.01320.pdf
🔴 PERFUSION: a generative AI model from NVIDIA that fits on a floppy disk 💾
It takes up just 100KB. Yes, you heard it right, much less than any picture you take with your mobile phone! Why is this revolutionary and can change everything?
I'll tell you 🧵👇 pic.twitter.com/Q2VG4VNQLy
— Javi Lopez ⛩️ (@javilopen) August 5, 2023
https://research.nvidia.com/labs/par/Perfusion/
https://ar5iv.labs.arxiv.org/html/2307.14936
https://www.linkedin.com/feed/update/urn:li:activity:7093463974750371840/?utm_source=pocket_saves
https://huggingface.co/syzymon/long_llama_3b_instruct
https://arxiv.org/abs/2307.03170
https://dynalang.github.io/
https://github.com/mlfoundations/open_flamingo
Open source LLMs have a major limitation.
But today, everything changes with the release of a new Foundation LLM Giraffe!🦒
So, what limitation does Giraffe overcome❔
❗️Open source LLMs have a max context length of 2k tokens, which roughly mean that they can not take inputs… pic.twitter.com/PQGSkWvxYy
— Akshay 🚀 (@akshay_pachaar) August 3, 2023
https://github.com/OpenBMB/ToolBench
https://llm-attacks.org/
https://arstechnica.com/information-technology/2023/07/openai-discontinues-its-ai-writing-detector-due-to-low-rate-of-accuracy/
https://sites.google.com/view/steve-1
https://github.com/Shalev-Lifshitz/STEVE-1
https://erichartford.com/dolphin
https://huggingface.co/ehartford/dolphin-llama-13b
https://www.mosaicml.com/blog/long-context-mpt-7b-8k
DWPose Colab 🥳 Thanks to Zhendong Yang ❤ Ailing Zeng ❤ Chun Yuan ❤ Yu Li ❤
📄paper: https://t.co/AXR5NHCXMF
🧬code: https://t.co/2fjWf5b7B7
🦒colab: please try it 🐣 https://t.co/UZf1hhPxRhArtist: @karinabalcerzak ❤ https://t.co/r6pFEnLo1J pic.twitter.com/4O57yvuHAb
— camenduru (@camenduru) August 6, 2023
https://github.com/IDEA-Research/DWPose
Announcing FlashAttention-2! We released FlashAttention a year ago, making attn 2-4 faster and is now widely used in most LLM libraries. Recently I’ve been working on the next version: 2x faster than v1, 5-9x vs standard attn, reaching 225 TFLOPs/s training speed on A100. 1/ pic.twitter.com/kWN58zcFDq
— Tri Dao (@tri_dao) July 17, 2023
https://tridao.me/publications/flash2/flash2.pdf
https://thehackernews.com/2023/07/wormgpt-new-ai-tool-allows.html
https://www.tomshardware.com/news/ai-steals-data-with-keystroke-audio
https://arxiv.org/pdf/2308.01074.pdf
https://www.foxnews.com/politics/ai-test-flight-air-force-unmanned-wingman-aircraft
https://www.theverge.com/2023/8/2/23817406/white-castle-soundhound-ai-sliders
https://www.google.com/search?sca_esv=556495916&q=food+delivery+bot+kicked&tbm=vid&source=lnms&sa=X&ved=2ahUKEwjZ6PDPrdmAAxUThf0HHWzrBGgQ0pQJegQIChAB&cshid=1691920142432720&biw=2327&bih=1180&dpr=2.2
https://www.thesun.co.uk/tech/20793591/coop-delivery-robots-cambridge-kicked-by-workers-tiktok/
https://ktla.com/news/local-news/food-delivery-robots-under-attack-from-vandals-thieves-local-businesses-starting-to-be-affected/
https://www.psypost.org/2023/08/chatgpt-is-much-better-than-humans-at-accurately-identifying-emotions-in-fictional-textual-scenarios-167380
https://www.theverge.com/2023/8/1/23815287/meta-ai-persona-generative-llama-instagram-facebook
https://www.cnbc.com/2023/07/28/microsoft-annual-report-highlights-importance-of-gpus.html
Links:
Homepage: https://ykilcher.com
Merch: https://ykilcher.com/merch
YouTube: https://www.youtube.com/c/yannickilcher
Twitter: https://twitter.com/ykilcher
Discord: https://ykilcher.com/discord
LinkedIn: https://www.linkedin.com/in/ykilcher
If you want to support me, the best thing to do is to share out the content :)
source
-
-
-
-
