Maximilian Kannen

•

The Future is Now

Author: Maximilian Kannen

Microsoft presents its copilot for Office

Today Microsoft showed off how they integrated AI tools, including GPT-4, into their office products. You can ask Copilot to build excel tables, PowerPoints, and Emails or ask it about meetings, or lets it summarise documents and chats. Although currently only available to a select few companies, Copilot is set to become widely available over… — read more

Mar 16, 2023
GPT-4 is here

OpenAI presented its new GPT model today. GPT-4 has a context window of 32K tokens and outperforms humans and previous models like GPT-3.5 in almost all language tasks. It is also multimodal and supports images as inputs. Read more here or watch the presentation here. OpenAI just released GPT-4, a game-changer in AI language models.… — read more

Mar 14, 2023
Google is publishing its new AI tools and APIs

In a new blog post, Google presents their Generative AI App Builder, PaLM API, and MakerSuite which works similarly to OpenAI’s playground. This announcement is happening shortly before the Microsoft presentation on Thursday. Similar to how they did it with their Bard presentation just before the Bing chat announcement. — read more

Mar 14, 2023
MathPrompter: Mathematical Reasoning using Large Language Models

Microsoft published a new paper in which they present the language model MathPrompter which uses the Zero-shot chain-of-thought prompting technique to generate multiple Algebraic expressions or Python functions to solve the same math problem in different ways and thereby raise the confidence level in the output results. This led to a score of 92.5 on… — read more

Mar 13, 2023
Jan Leike Shares His Ideas on Alignment

Jan Leike, the alignment team lead at OpenAI, has published a blog post where he presents possible solutions for AI aligning to group preferences. He proposes a simulated deliberative democracy, where groups of randomly selected people agree on a stand on a specific topic. The decision is then used to fine-tune the AI. — read more

Mar 9, 2023
GPT-4 Next Week

In a small german information event today, four Microsoft employees talked about the potential of LLMs and mentioned that they are going to release GPT-4 next week. They implied that GPT-4 will be able to work with video data, which implies a multimodal model comparable to PaLM-E. Read more here. — read more

Mar 9, 2023
Large Language Models: An Overview

Large Language Models (LLMs) are machine learning-based tools that are able to predict the next word in a given sequence of words. In this post, I want to clarify what they can and cannot do, how they work, what their limitations will be in the future, and how they came to be. History With the… — read more

Mar 8, 2023
Google crushes Speech recognition

Google released the Universal Speech Model (USM), which can transcribe over 300 languages. It outperforms the state-of-the-art model Whisper in the 18 languages that Whisper supports. This is part of Google’s plan to support the 1000 most spoken languages. The model is with 2B parameters slightly bigger than Whisper and was pre-trained mostly on unlabeled… — read more

Mar 7, 2023
Google presents PaLM-E. An Embodied Multimodal Language Model

PaLM-E has 562B parameters which make it one of the largest models today. It combines sensory data from a robot with text and image data. It is based on PaLM and was fine-tuned on input & scene representations for different sensor modalities. These kinds of more general models are the way to more powerful and… — read more

Mar 7, 2023
Meta compares Brain to LLMs

Meta published an article where they compared the behavior of the brain to large language models. They showed the important differences and similarities underlying the process of text predictions. The research group tested 304 participants with functional magnetic resonance imaging to show how the brain predicts a hierarchy of representations that spans multiple timescales. They… — read more

Mar 2, 2023
OpenAI released Whisper and chatGPT API

Just a moment ago OpenAI opened their ChatGPT and Whisper API. they also published their previously leaked dedicated instance service. ChatGPT will be available for 0.002$ per 1000 tokens which is incredibly cheap and will be getting updates regularly. Whisper will be available for 0.006$ per minute of audio data. — read more

Mar 1, 2023
Organoid Intelligence: creating biological computers out of the human brain

A team of researchers published an article on their research on biocomputing. It goes in-depth about the potential of such systems and how to build them. The core idea is to grow brain tissue out of stem cells to use the high energy efficiency and ability to perform complex tasks with organoid-computer interfaces. Instead of… — read more

Mar 1, 2023
Microsoft lets you talk to robots

Microsoft showed how to use chatGPT to control robots with your voice. APIs and Prompts can be designed to enable chatGPT to run the robot. By combining the spoken task with API information, it is possible to let chatGPT generate the code and API calls to execute the task with a given robot. While this… — read more

Feb 28, 2023
Microsoft published KOSMOS-1, a multimodal large language model

Microsoft released the paper “Language Is Not All You Need: Aligning Perception with Language Models “, where they introduce their multimodal large language model KOSMOS-1. KOSMOS-1 is still a language model at its core, but it can also use other training data, like images. It shows impressive results in a number of tasks, such as… — read more

Feb 28, 2023
OpenAI addressed Alignment and AGI concerns

OpenAi released a blog post about their plans for AGI and how to minimize the negative impacts. I highly recommend reading it yourself, but the key takeaways are: — read more

Feb 24, 2023
New LLMs by Meta.

Meta released 4 new Large Language Models, ranging from 6.7B to 65.2B parameters. By using the chinchilla law and only publically available they reached state-of-the-art performance in their biggest model which is still significantly smaller than comparable models like GPT-3.5 or PaLM. Their smallest model is small enough to run on consumer Hardware and is still comparable… — read more

Feb 24, 2023
Google found a way to make Qubits more stable which scales well

A new paper was published by Google where they present their advancements in quantum error correction. By scaling to larger numbers of Qubits and combining them to logical Qubits they can reduce the quantum error rate significantly. This opens up a clear path to better quantum computers by just scaling them up. — read more

Feb 23, 2023
New Paper by Google uses Generative AI to train Robots

Google just published the paper “Scaling Robot Learning with Semantically Imagined Experience” showing how to use generated images like Imagen to generate Training data for their robot system. This allows the robot to have a more diverse data set and therefore be more robust and able to solve unseen tasks. We saw similar approaches using simulations for… — read more

Feb 23, 2023
Al used to develop CRISPR alternative

The NYU Grossman school of medicine published a paper that showed that by using AI it is possible to build zinc-finger protein structures that are as effective and fast as CRISPR and also a potentially safer alternative to CRISPR. This shows once again that AI and biology work perfectly together. — read more

Feb 22, 2023
Huggingface and AWS announced their partnership

Huggingface and amazon AWS announced their partnership to scale AI in the cloud. Amazon is already the leading cloud computing provider, and Huggingface is the biggest platform for machine learning developers. This will hopefully lead to cheaper and faster development of AI solutions for smaller developer teams and companies. — read more

Feb 22, 2023