COMPUTER VISION PROJECT ~ DEMO VIDEO
This video shows 3 views:
1. the user interacting with the objects
2. the reactivision camera sensing the fiducial barcodes and
3. the max/msp process and output.
Senerios
– If there are no objects on the table the display is inactive.
– Once the model is placed, information about the context appears, rotating this will zoom in/out of the site context.
– If a data cube is added the second display will activate, and if the cube is rotated it will scroll through the images. There are 3 different data types: plan, section and perspective.
– Once the data cube is removed an idle video will show about the project.
– Once the model is removed it will switch to an idle screen asking you to place a model.
COMPUTER VISION PROJECT ~ CONCEPT
Hardware set-up
This was The ideal setup with multiple models and a projector.
This was the actual setup with a single display and model.
Interactive Interface
COMPUTER VISION ~ CODING
Reactivision/TUIO client
Using Max/Msp we start off by acquiring the TUIO client to support reactivision, this patch includes 15 preset fiducial sensors which detects rotation, the instance when it is introduced to the camera and when it is taken off as well as its x/y position. We use the data that this patch creates to create the table top interface.
1st Project trial
This is our first attempt to make use of the data, basically using the bang object to activate the movie and the rotation of the barcode to play specific frames of the video. The issue with this was that there is very little control in the output video, the frames keep on rolling and jumping back to the indicated $1 frame.
2nd Project trial
In the second attempt we added a note when the barcode is added as well as start the metro and stopped it when the barcode is removed. The problem of the video jumping glitch still persists and the stopping of the metro stops the video at the current frame which was a little awkward.
3rd Project trial
Here we tried to fix the glitched video jumping by introducing a constant frame rate with the barcode controlling whether it scrolls forward or back wards. We also introduced an ‘inactive’ video when no barcodes are present. The issue with this was that the rotation feature didn’t feel like it was used to its potential, it felt like we could achieve this with a forward and back button only. We also added a new output window to show 2 simultaneous info stream. A new problem that arose was that there were too many video files now and the patch sometimes played a wrong file because the connections were overlapping.
4th Project trial (Working Beta)
This was the working beta of the project, we reverted back to the frame $1 system and stabilized it by introducing its own metro so that it constantly stays at the indicated frame. We also used switches to isolate the video streams so that only the right files are played. We also added master start/stop buttons so that we can set the patch to the intended settings. The only issue now is that this patch only supports 1 model.
Further projects trials
This patch was an attempt to introduce 2 more models (giving a total of 3) and controlling each individual data and information whilst controlling it with a single data cube. Unfortunately due to time constraints we have not been able to finish.
In a previous post, the patch (tracking cam with 3d output) was an attempt to introduce a 3d media into the interface, but due to technical issues we could not implement it into the project.
GROUP PROJECT COMPUTER VISION idea by Adit (http://aditya4i.wordpress.com)
The project deals with computer vision, to create an augmented reality interface to present an architectural project, using computer graphics and physical model of the architectural project.
From the discussions in class and research we have found various case-studies about what we could use to construct the project. Basically try to bring the idea of computer vision.
use – Max/Msp
use – Reactivision
This application can be used alongside max msp and can track and detect fiducial barcodes and fingerprint shadows from a camera source in an X/Y axis.
use – Artoolkit
This application produces real-time 3d projections from a barcode through a camera, it is able to track the barcode in an X/Y/Z axis creating a simple AR tool.
WHAT IS COMPUTER VISION?
Computer Vision is the term which is used for the machines where they can easily work for the extraction of the information and then that information can be used for the purpose of solving some of the problematic tasks. The information is mainly extracted from the image. This is the new form of science which only deals with the machines. When the information from the images had been extracted with the help of the artificial systems, then the computer vision is defined to take place in this form and as a result it is tend to be described in the form of a science. Moreover the extraction of the information can take place in different forms which can actually include the videos, camera views and the multi dimensional view of data with the use of the scanner. The term computer vision had also been described with the help of the technology in which it deals with the theories had been applied for the construction of the system for the computer visions.
kleness 