Hello world!

The first post on this English blog

Comments

Post a Comment

Popular posts from this blog

Project ISKRA - introduction

Hello everyone reading this blog! In this article, I will introduce you to my new long-term project - ISKRA. [Insert logo here once I get it] ISKRA means "spark" in Polish, it stands for Inteligentne Systemy Kontroli Robotów Autonomicznych. That translates to "Intelligent Systems of Autonomous Robots Control". But what is ISKRA and goals of the project? The answer is - to see how conversational artificial intelligence, such as for example ChatGPT; can deal with control of physical robots or digital bodies in different situations and with different tasks . The final goal is to create fully autonomous, intelligent systems capable of understanding and dealing with different tasks in different environments. This series of articles will be my experiment log, and some thoughts on how to achieve certain things. My articles related to it will not be professional scientific documents. I want them to be readable and understandable for everyone. Maybe once I get to some notewo...
Read more

ISKRA experiment 02_10_2024-1 - "Defeat the Minecraft creeper" [reupload]

Image
ISKRA experiment 02_10_2024-1 - "Defeat the Minecraft Creeper" Hello everyone! In this post, I will describe my recent and first public ISKRA Project experiment. I have conducted some experiments before, but I believe they are not worth publishing. Let's consider this one the first official ISKRA Project experiment. Let's begin with the description of it. I've built an installation in Minecraft Bedrock Edition: This was the starting point and viewport of our AI: The goal of the AI was to defeat the Creeper by using a set of pre-defined control commands: W - move forward 1 block S - move backwards 1 block A - strafe left 1 block D - strafe right 1 block P - place a brown dirt block in front of you R - destroy block in front of you F - punch to attack/fight The commands P and R were never actually implemented since they were unnecessary for this experiment. The Creeper was trapped in a structure to prevent...
Read more

Using agent-based approach to make ChatGPT capable of video analysis - part 1 - proof of concept

Image
Hello everyone! Today, we will create a way to let ChatGPT watch videos. But first, I will describe my approach to this problem. So models like GPT-4o and GPT-4o-mini are able to analyze static images. My approach to let the AI analyze movies will look like this: - The video will be split into individual frames on specific interval. - Certain amounts of the frames will become scenes (for example 8 frames when the frames are took every 4 seconds will make a 32 second long scene in total). The scenes will then be assembled into images containing all the frames, creating sort of a "comic". - If set to do so, audio fragment for each scene will be processed thru speech recognition to get transcript of dialogues. As I am writing this, OpenAI released a model gpt-4o-audio-preview, which they claim can analyze audio; but since I haven't used it yet, let's first extract speech with a classic speech recognition library. In this part I am not going to add audio support yet tho. ...
Read more