From Reality Capture to Immersive Heritage Experiences with Tomas Barnas | INTERGEO 2025

So uh as I'm uh not as I was not supposed to be in the program the the presentation is still copying. So before you will see something from our work I will just tell you few words about about us and our technologies. So overall uh as you said I'm the founder of overhead 4D and we are focused on reality capturing industry uh doing and using all the laser scanning uh technologies which you can see here but combining them with uh photoggramometry. Why? So uh the simple reason is that uh we need for our projects uh the high accuracy but very important is as well the high visual accuracy. So we need to represent the places even visually accurate uh for which is needed to use the photoggramometry technology. Uh besides that we are focused and looking at uh the newest technologies as gausian splitting and trying to incorporate all of those technologies into our our pipeline and being I would say or looking at the future of reality capturing as itself. Uh besides our uh our technologies and our services we are also like uh happy to share our uh knowledge and knowhow and we do and provide a lot of trainings in uh that field. So whatever you see we are able or what whatever you will see we will be able to teach you or if you are open and interested in uh bringing some of the technologies into your pipelines uh yeah feel free later to reach out but uh I hope the presentation will start soon that you can uh see everything what we what we do uh actually besides this as you mentioned uh I'm the founder co-founder also of three dice conference which is the partner ner of interjeo here and we are doing also a podcast session uh and how this goes together with uh with our service providing uh that's simple simply the point which I mentioned that we like to share the knowledge which we have and knowledge sharing is really building our industry and this is something what we try to expand and uh yeah thanks to this collaboration with interio we were able also in April to uh launch our first year of the conference which will be continuing next year as well and it will be focused on reality capturing uh mainly. So who of you is interested to travel also to Brag will come and uh yeah hopefully to see you there. So they're showing me that it's uh one minute uh so I will start yeah exactly it's getting there. I will take the clicker and uh it's still copying. So um I will speak first part of my presentation is always uh showing the historical site and uh also the our company is focused on digitization of cultural heritage and not only digitizing that what we see today and what exist but also uh the things which were there in the past. So often we collaborate with historians and uh we are uh we are scanning the sites as they are today and then working with researchers and trying to get all the informations how the site could look like in the past and then we are taking all the data compiling them and building up the the visuals which you could not even imagine or which were normally just on the spoken words. So this is something what uh what would be nice if you could see once. So maybe maybe we'll manage that. Um besides that UI was also mentioning the the bigger cultural heritage project we worked on which is uh for example Machu Picchu or pyramids in Egypt and u those sites are very challenging not only for getting permissions to get there but also to process. If you imagine pyramids as as simple uh objects, you have like three of the same objects. All is sent. Everything is equal and then you have to be able to process those data. And uh yeah, that's that's uh always complicated. Uh just give me a second. I will give them my laptop. Maybe they can play it from that. Okay. So, I see there's still like downloading in two minutes. It's a big presentation because uh I like to show always visual things and uh that's full of the videos and and all the showcases. So, but now it seems to be done. Perfect. Perfect. So now uh yeah now you can see it perfect. So sorry for that. Uh as I already started uh to speak about the topic of cultural heritage and uh and the digitization. So the process is um combining all the technologies starting with the drones drone capture and as you can see uh here we have combination of laser scanning photoggramometry drones in interior in exterior. So like very complex objects what's the output or or why this goes on many of you will know point clouds and point clouds are of course part of our our processes as well and uh this is just the first stage and important here what I like to share and what I always like to say is that um we are creating this data uh with a high accuracy that means they are also used as a technical underlays many times for reconstruction or for any adjustments in the existing um buildings or heritages. And the point of that is that we create the data which are used for a technical reconstruction but we give them a second life. Combining them with photoggramometry we are getting to the qualities like this one and you can see how precise and how accurate it can be also visually because below that we have a scan data. As I said, they were used for technical reconstructions and this combination allows you to give a second life to them. What that means you are selling to your client the data once for a technical purpose but you have those data and why not to bring them to to life again and as here use them for for example marketing or as a interactive guide. So we were taking this data and putting them inside of touch panel which is used in the same heritage in the same place and visitors now can walk there touch it play with it and learn about the the site more than they could ever before because they are not allowed to walk everywhere and like this they are able to visit the places to actually read about them or hear about them even without having access there. As you can see here, that's another case where you have different languages, different over um overlays just playing around it. Going further, as I spend most of the time waiting, uh now I have to do it faster is that you can see various sites again capturing laser scanning and the outputs which are commonly used and known uh 2D maps uh and plans for reconstructions which are again a first step. What could come as a next? The next could be something what people can see on site because I was showing you uh a touch pad and you know like you will not bring this place everywhere outside. But look at this ruin of the castle. On one side you see the ruin of the castle. On the second side you see already reconstruct reconstructed site and uh here you see around 6,000 images combined with the research of historians. So it would look like this the input and then you combine it nicely and start to create uh a place which is showing you how the site look like before in the past. Yeah. This is combination of the scanning. Yeah. The bottom part is like scanned area. The top part is from uh 3D modeling bringing texture on top making it visually attractive and also visually representing the the the past look of it. So we play with the structures of the walls, the the roofs, every material should be representing the the visuals of the past look of it. Uh going further is like that's like we are creating the data but what to do with those data. It's how you bring them to the audience and here in this case open spaces exteriors you can't really install there any electronics. So we turn it into AR application augmented reality which actually allows you to download the application and see the site in a past look. So you are going there you are going to any place which is destroyed today maybe or doesn't even exist and then you can link it via GPS or markers as here and uh when you load the markers and look upwards you are seeing the overlays. So you overlap past uh look with the with the current stage and in how how many details you can display. Yeah, there is no limit. It's like with scanning. It depends on how you are focus what what's your focus and what you want to display. Here for example you can see the photoggramometry reconstruction with a laser scanning of a castle which exist and moving towards a part which doesn't exist but it doesn't show only it look but it also shows how it collapsed why it collapsed that the wooden pieces burnt and they cracked the stone and the stone collapsed on the left side so historically accurate reconstruction it's not maybe in the quality of Hollywood movies but it's even not needed because the target was to show the research Going further uh combining the technologies means you don't have limits about where you want to go whether you are in the air the ground underground or under the water. So here you can see photoggramometry being used in uh like underwater uh level. It's 72 mters below the sea level. the divers which were capturing it uh by diving not any aerovs used or any drone underwater. It was back in 2000 and it took them 10 years to capture the images and in 2010 uh the photoggramometry was already that far that we could start to work with them and reconstruct the look of the shipwreck lying on the on the seabot. And what can be done with the data like this? They can be used either digitally or also physically. That means you can 3D print them. You can 3D print them in scale or in one to one if it's not a ship like this. And then having the data and again combining them with the informations about the ship from the past, it's giving you a chance to reconstruct again something what was there before. So this is the the look of the ship from the 16th century. And once you have the data, why you wouldn't push it further and bring it into life? So again having the data of the shipwreck turned into a ship itself and then you can build up a 3D movie which is telling you the story of how the ship was destroyed because like in 16th century they were like saying about this ship that this is kind of nowadays like past Titanic. They expected it's undestroyable and of course first time when they brought it on the on the sea they destroyed it. So here is the entire process how this happened and you can change the data and usage of the data in in various ways and here you can see the view through the spy glass on the ship where which is built in the museum and you can be looking around and seeing uh like the ship battle around you like you were part of it and moving further I have last few minutes so just a quick uh view on our last project Machu Picchu which we uh delivered this year where we did the digitization of the Machu Picchu itself but the use was a 3D virtual reality movie and now it will jump far away from scanning because the part of the movie is always also having some characters or actors. So we see here like sketch and drawings of of people which we wanted to bring there as old incas people living there and you see here that also bringing the animations which are uh yeah animated like this but as this is not a scanning part I will just move quickly through that and this is like a combination of the uh animated figures and the 3D scanned environments and we brought them live into VR movies and how the VR movies are working is that you have a venue where you are walking with a headset but we bring you to another world. So you're actually like walking in some venue like this but what you see it's totally different and you see yeah you see this. So here I would like wrap up my presentation and uh uh this is a thing which you can get also from the data you are working on. It's just a way of imagination how far you want to push the data and how far you want to uh play with them and develop them. world. >> So, thank you very much for your attention.