Java Media Framework is a java library which enables to use real time images or videos in java applet. For image processing in Project-C.S.R, JMF was first used. The rendered real time image is take from the JMF and that image is used for image processing. For finding a specific object in the image the shape, size and color of the object is used. Blue-LED lights were first used to be detected in Project-C.S.R. Now, for detecting the light the image had to go through some processes for finding the light. The first process that the image goes through is that all of its green and red pixels are removed. The reason for this is to detect the blue color in the Blue-LED light by differentiating it from other colors and. To remove these red and green pixels a threshold value is used for both the colors.Once the red and green pixel crosses the threshold value the pixel at that point is converted to black.
Original Image.
Image after red and green pixels removed. Showing only the blue part.
This is the WiFi Video Streaming from one device to another. Currently it streams video from one computer to another through WiFi but later we will implement it in android. Our goal is to stream the game screen from a device with high processing power to a low processing power with the ability to control the playable characters.
In this video we show a small preview of character control through image processing. Here we just show how the characters arm has been controlled by the user. For the next episode we shall show the full character control through image processing and how it works.
This demonstration contains usage of voice processing for game input and game user interface. It also contains a conceptual avatar that can look at you from the screen by detecting your face and can take voice commands. A brief demo of multiplayer network is shown which will be extended later.
This our first video of Project-Control Scheme Revolution (Project – C.S.R ) Here we show how the game works. We also show what we used in Project-C.S.R
Project : Control Scheme Revolution researches on the new generation of command and control in the virtual world of gaming using real time voice and image processing and test it’s usability for massively multiplayer gaming purposes. As the new sort of command and control in console based gaming industry such as XBOX-Kinect or PS3 MOVE is being popular where players physical movement becomes input for a game, this project emphasizes to bring the same feeling in the games on personal computers using computer vision and speech recognition for controlling playable and non-playable characters. Goal of this project is to make the feeling of gaming more realistic as our real life experience says that we mostly communicate with people around us via voice or gestures and this project will give us the same facility to interact with fairly tale characters of games.
