Technology has evolved so much in the past few years that computers and have tablets have virtually replaced the traditional teaching aids.
Take a look at how it has changed in the past few years:
Take a look at how it has changed in the past few years:
Disruptive technologies like Augmented Reality (AR), Virtual Reality (VR) and Artificial Intelligence (AI) are changing the face of enterprises as we know it. Appearition is constantly working towards educating young minds in these technologies and making them future ready.
Appearition along with our partners Real Time Learning and Epson was a part of a day-long session to educate kids between the ages 9 and 12 and provide an overview to their parents on Extended Reality (XR) (which covers the spectrum from AR to VR) – what is it all about and how one can use it.
The event was organised by ANZ bank for the children of staff over the school holidays in support of STEM (Science Technology Engineering Mathematics) workshops.
Sujanth and Brendan of Appearition provided guidance through the day, supporting hands-on learning with AR and VR.
Epson’s Dwayne Williams brought Moverio AR headsets to enable kids to experience AR. Several kids and their parents learnt in detail about the basics of the technology, its application and benefits.
‘Students experienced Virtual Reality and were amazed to see virtual structures outside of the gadget. We believe that when students get acquainted with these technologies, it helps provide a better understanding of potential careers when they grow up,’ says Brendan Ridge, Solutions Specialist, Appearition.
This is one of the many EdTech outreach programmes that Appearition has been championing in the recent times. We hope to inspire a lot more in the days to come.
A look at the trends and impact of digital transformation and possibilities of AR in education and training
Technology has become an imperative part of education in the past decade. The introduction of immersive technologies meant interactive classes and unparalleled experience in learning. A study conducted by Justin Tosco, a master’s student at Saint Catherine University, shows that students prefer lessons that use technology.
The study found that there was 16% accuracy in short answers and increase engagement for students taught with the aid of technology.
We are currently living in a fully-digital world with average adults spending over 5-7 hours a day on the internet. And Generation Z – a popular name for today’s school-going kids, have grown along with this digital boom. This makes them quite familiar with the use of technology in everyday activities.
Research by Geer and Sweeney (2012) showed that the use of a variety of media applications to explain concepts increased the understanding and supported greater collaboration between students.
AR provides an efficient way to represent a model that needs visualization. This immersive technology provides seamless interaction between the real and virtual world. Furthermore, it facilitates field visits within four walls, thereby increasing visual retention.
Students learn multiple subjects at school and need to remember them all. Technology like Augmented Reality and Virtual Reality bring content to life. Studies suggest that visual memory appeals to mind within 0.01 second! Students learn as they see, thereby sub-consciously retaining knowledge.
Generally, teaching is believed to be the mode of acquiring knowledge or learning. Immersive technologies facilitate self-learning, in a fun and engaging manner. Subjects like History, which are narrative and quite visual, can be easily learned through these.
As a study rightly says, use of technology involves real-world problems, current informational resources, simulations of concepts, and communication with professionals in the field. In addition, learning using technology is believed to complement the traditional forms of teaching and learning. This promotes the visual, auditory and speech senses simultaneously.
Learning and paying attention to new concepts are challenging for children with autism, down syndrome, etc. AR and VR have proven to improve their attention span, aid in expressing their self and improves their interactive behaviour. Furthermore, these technologies act as students’ centre of attraction, thereby reducing any possible distraction.
Learning about obtuse triangle or explanation of food chain through mere theory makes a student’s life difficult. These are abstract concepts and are understood better when demonstrated. Augmented Reality and other similar technologies bring such abstract subjects to life with their overlay and video demonstration capacities.
Learning by viewing animated objects leads to better understanding and simplifies what is taught. Immersive technology such as Virtual Reality can enable students to feel or experience some theoretical concepts like air pressure, or the working of Archimedes principle.
We have discussed on technologies ability to simplify learning. Let us understand this further:
The introduction of powerpoint slides or projectors meant students had a visual aid to break-down important points while being taught. Whereas, some of these technologies weren’t accessible always and by all students. With high levels of mobile penetration to Gen-Z, today’s technology like 3D learning, AR, VR, MR and AI are all accessible at the touch of a button on a mobile.
These technologies enable re-visiting and learning a concept at an individual time and pace. They further act as a personal tutor for students, walking them through every step.
History and Civics are two subjects with relatively easy concepts to understand but can be quite monotonous if learnt theoretically. Use of technology in such subjects enable objectification of content and provides a skeletal frame to what is taught. For instance, when learning about legislature or an assembly, students can play-out scenarios of a majority, coalition or stages in creating a law. These are effective methods of teaching and enables them to grasp concepts better.
(Source: University Teknologi Malaysia Research)
AR and VR are widely being used to train medical students in a number of ways. VR can be leveraged in training medical students and residents on procedures for a more truly immersive experience before engaging with real patients.
For patients, these technologies can speed education about conditions or treatment plans.
Use of virtual cadavers in anatomy training is one specific example, which can be extended to practice sessions with an AR-enhanced smartphone.
(Excerpts from Deloitte Digital Trends report)
The University of Twente, Netherlands is developing an economical smartphone technology based on the usage of Simultaneous Localization and Mapping (SLAM) and Augmented Reality (AR). This technology enables medical personnel to reconstruct 3D body sections quickly, by directing the smartphone to the area of interest.
|Subject||Purpose of the technology||Features used|
|Provides an efficient way to represent and interact with molecules||AR exhibits|
|Using a glass tabletop laden with coffee mugs and popsicle sticks, students rearranged the objects in a recent teaching exercise to simulate reactions in a real-life, sprawling chemical plant.||Projector, AR table-top, QR coding|
|Aides teaching geometry, shapes, area etc||AR and MR|
|Facilitates virtual tours; enables visualising different flora and fauna. To a certain level, immersive aspect lets students experience air pressure or view how a water cycle is complete.||AR, VR and MR|
|To gather information and enhance the experience of visitors to cultural organisations (museums and archaeological sites)||Mobile AR educational games|
|To teach participants that habitats are connected like links in a chain (food chain)|
Facilitates students to view micro-organisms and their characteristics without the help of microscope (to an extent)
|To overlay graphics on top of the physical props to visualize these forces (speed, velocity, acceleration, pressure, friction, energy changes) invisible to the human eye||Augmented video, video conferencing, tracked physical props (e.g. toy cars)|
|Enables 3D visualisation and walk-throughs of cites;|
helps assess structural worthiness, measure area and volume;
aides error correction in draft plans easily with its layered approach
|AR, VR and MR|
|To show augmented views of the celestial bodies and support learning using spatial visual guides and views from a terrestrial observer||AR and VR|
|Enables complete learning of body parts from the external skin to internal organs;|
facilitates in learning more on surgical points;
virtual cadavers help students overcome the fear of surgery;
virtual reality provides medical and dental students a safe and controlled environment to practice surgeries and procedures, allowing them to make mistakes without having any impact on an actual patient, and prepare for any unexpected situations.
|AR for body over-lay|
Holo-lens assisted surgery in VR
|Will aid in separating verified and unverified news information;|
news aggregators will also help identify a breaking news through social media and other related uploads before the first official news is out.
Technologies such as AR, VR, MR, AI etc are fast changing the face of learning and education. Integration of these technologies benefits teachers along with students. With the aid of technology like AR, visualisation of subject matter improves. Teachers can impart knowledge and facilitate learning in a simple way.
Use of technology in learning should be focussed on student centred learning. As observed earlier, these have vast use in almost every field of work. These technologies have become the new basic skillset to work around just like emails and mobile apps.
Businesses are adopting AR and VR to enhance processes. They have proved to save time, cut costs and increase efficiency.
As disruptive technologies grow, thousands of jobs will be created, and several others’ skill sets will widen. Introduction to these technology concepts from school will better prepare students for a digital world ahead.
Mouli Ganguly, Member, Board of Advisors, talks on Industry 4.0, Digital Transformation, Frontier Technologies and more:
All of them play a role in terms of Digital Transformation. So, let us take an industrial example. Dump trucks used in mining have huge tyres. Their worth is about a million odd dollars and some of their tyres cost up to $100k. Now it is important to see the level of productivity an application can deliver. The benefits are already clear & compelling.
Every modern piece of truck has got transponders all over the place. That kicks in the IoT element. This enables us to track what it is doing by tracking the signals received. With AI and insights, what we can do with the data coming through is, collect and put them in a place. We can decide here is what I want to get the data or do something about it.
With AR, VR and MR, you render the whole application to how the user can best use it, with data and insights. For example, you could present the same information that you’re collecting via transponders to the truck drivers in a manner where he can see the whole environment around him. You can set it up, such that language is not a barrier. In India, for instance, truck drivers driving cross-country speak different languages. Irrespective of whatever language one speaks, they can all see an image, interpret & take decisions. Every driver knows what a boulder is. Or what are the factors that may damage the dumpster or damage the tyres or something else. Whilst sitting inside the dumpster, they may not be able to view everything through naked eye.
Another way to grasp all this up – you see a control room can observe the movements of a dumpster. They receive the information from transponders and visualise the data and interpret the implications that arise from it. They can then come up with solutions like specific risk issues or actions that need to be taken. A team from the customer & Appearition has to plan this out.
In terms of Blockchain, it makes sure that a certain event, transaction or data, is stamped as authentic. It is not widely used yet. There are restrictions on its usage or application. But for transactions of high value, this technology not only gives you an experience but also makes the transaction very safe and auditable. It also facilitates to build a record as to who did what at exactly when. This can also act as an audit trail for any purpose required. It is a foul-proof way to keep track of things. The transaction can be financial or otherwise.
So that is how all the technologies can play a role in Digital Transformation. Often a combination of these technologies that answers / solves a business problem.
Typically, early adapters are an organisation’s visionary. They are in the very senior position. Also, in a generational sense, say between gen X, gen Y or the middle aged people, there are several technology gaps. Kids born after 2000 basically grew up with screens. Just like millennials grew up with the PCs. Every time a new technology is introduced, you think of things in a very different way. For example, in my generation of baby boomers, , people would write text for a power point presentation. Whereas, these days, a presentation is far more experiential.
In an organisational context, the gap is often at thinking through the process change or adaption for an idea. If the plan is not backed by experience or relevant subject matter expertise, it will fall through.
As an early adapter, the visionaries come up with ideas. The cautious players are the ones who go through the practical things. So, they go through factors like business use case, defining what will change, how will it work, the change management and integration part of it, how to get data out of organisational system that exists, make sure that the data is accurate, quality is good.
Early adapters are analytical thinkers/dreamers. Cautious people on the other hand, achieve dreamers’ dreams. This kcan take a very long time. Now, where an organisation is driven by a visionary, often, you get things moving simply because he has got an idea that he wants to make it happen. And he (CEO/COO) will tell somebody typically that, ‘look I just want to make it happen. Work as a team and make it happen’.
For an early adapter enterprise, if you get the vision right, you get a first mover advantage over others. For instance, the Facebook phenomenon. They have created an entirely new business. Whereas sometimes, early adapters who did not plan well have gone bust. Because, they have placed some bets that have gone awfully wrong. And this has sort of impacted their existing business, customers and whole the lot. Cautious players tend to be thoughtful followers. They let others experiment and use those learnings in their business. They try to keep their profitability high and ensure quality, risk management & repeatability, so thatcustomer engagement does not take a hit.
There are whole lot of methodologies. In my view really simple. The agenda very much is a COO/CFO/CIO/CMO/CPO idea. The CEO says this is what we need to do. The CMO then says, this is how we want to market it. This is the experience we want to provide. The CPO Says here is the culture or context in which I want my people to operate. Those are the three elements – the customers, the culture, the strategic direction and somewhere in between there is an elephant in the room, the digital space. Compliance, security, all those kinds of things. All this has to hang together be funded effectively and provide return to the investors, That is why you need a special type of CFO for the digital businesses. That is very important in terms of creating the digital IQ.
You drive the innovation, which is the business agenda. Secondly, you need to be agile. Agility is where you can own up to your mistakes quickly when needed and at a low cost. The whole team, not just some champions must work together on an agile manner. We need collaboration within the organisation and with the suppliers & customers. Within the compliance ecosystem the regulatory authority, and any number of agencies are there, because the laws haven’t caught up in Digital yet. And the next comes the partners. Because no one organisation can do everything by themselves. It is very, very important for the partners to work together. Again, look at what Appearition is doing. They work with a whole lot of partners to deliver what must be delivered. And, at another level, the IQ is built through great culture of innovation and risk taking.
The first question you ask is why are you doing it? What is the innovation? Why am I doing it? What difference will it make? And the ability to execute, in my mind is the other side of the equation. The CIO, the guy whom implements the technology. The CFO, the guy who checks out the money, burning millions of dollars, putting things at risk. Those kinds of functions become responsible of every action. So, the whole thing is a question of balance.
The ability to execute the vision is possibly the biggest challenge of the Exec team.
If you take the first thing that comes out in the digital world, it is data. There is so much data in every aspect of our life, every moment. We are being absolutely bombarded with data. Our memory spans have reduced. In today’s mindset, I don’t think people have the patience to read a booklet. This data is compressed and made consumable through AI and Analytics. This is turned into information. But then, to turn it into information, you need to know, what information you were after. You need to take the data in a certain way. From information, comes knowledge. Then you personalise it. Then you look at the information and say, I’ve read the report, what I’ve learnt out of the report is this, this and that. And then, beyond that comes very, very content specific, decisions.
For instance, if you are an insurance company and you want to know the information on who are the people who do not have an insurance and are most likely to become my customers? And if there are certain attributes that you identify, you may decide whether it is important or not and do something with it.
2/2 of his exclusive interview. Click here to read the first part.
In our last series on AR-VR in Education, we touched on the basics of these technologies in education, how teachers’ roles can be shaped to make them better educators and how students can benefit from immersive technology.
Augmented and Virtual Reality are no longer in their stages of infancy. They are widely being used across multiple verticals.
A Lenovo research found that almost 50% of teachers estimate VR will be commonplace in schools in the next five years.
(Image Courtesy: thinkmobiles.com)
Studies suggest students can absorb a visual scene within 0.01 seconds! Moving towards a fully digital world, AR and VR act as the window to this visual sense. Students get a first experience and wholly understand a concept. This method of teaching promotes visual learning beyond just kinder-garden.
Immersive technologies are set to change to completely revamp future ways of learning and teaching by bringing the world inside the four-walls.
A look at the highlights of 2017 USA Field Service Benchmark Report:
Technology and Digital Transformation continues to shape the service industry. Most of the respondents said, their strategy was ‘mobile first’. Growing emphasis on mobiles and abundance of data is enabling organisations to focus on mobile technology and transformation.
Among many booming technologies this year, 72% respondents said they’ve adopted or planning to add the ropes of cloud to their business. 30% of the businesses have added or planning to add the ropes of Augmented Reality (AR).
“I was quite surprised to see that technician adoption of new solutions ranked so highly as a challenge. With today’s technology, equipment comes to consumers, employees, and to businesses more and more without a real need to instruct on its use. The perception of complexity is really what holds technicians back. We invest a lot of time and energy into making technology easier to understand, and we deploy tools in the field that are as easy to operate as common applications you can run on IOS, Android, or a Windows device,” says Martin Knook, CEO Gomocha
Surprisingly, 42% of the respondents said they initiated/ adopted digitisation and automation of field service activities to reduce costs. 34% of them wanted to go digital to increase transparency and ensure viability as a business.
Technology is ever evolving. There is constant need to adopt to these innovations. The question here though, is how adoptive are businesses? 35% of the respondents said they’re agile enough to adopt an innovation cycle every three years. While, 28% of the enterprises preferred to work with solutions that were scalable and relevant for at least ten years.
This article is a re-written excerpt from the 2017 USA Field Services Benchmark Report. The graphs were sourced from the same report.
Ravichandran Lakshminarayanan, Member, Board of Advisors, Appearition India speaks on Augmented Reality, Digital Transformation trends and the Indian market and more:
Though AR/VR arrived, so to speak, may be about three years back, significant impact or adoption (usage) is yet to be seen, be it in the consumer space (though we have VR centres in some malls or VR headgear sold with smart phones) or in the enterprise space.
AR/VR is certainly going to be a game changer for industries like retail, real estate, entertainment, and tourism in India.
Education is another area where we will see significant AR/VR adoption. (I foresee not only schools & colleges taking advantage of the power of AR/VR, but many other formal and non- formal fora including corporate/industrial training will take advantage of these frontier technologies).
India is a price sensitive market. Today there are more than 300 million mobile phone connections, in India. Mobile phone sales literally skyrocketed, only because device prices came down drastically.
Mobile phones are going to drive AR/VR usage and it is very important that the AR/VR capable phones are priced right for the Indian market.
Next is content in local languages like Tamil, Hindi, Telugu, Kannada. For AR/VR to drive mass usage/adoption, local language content will be a key.
Last but not the least, the devices(phones) will have to be more user friendly than they are now.
Today there is no business that can shun or stay away from digital transformation. The degree of transformation or rather what percentage of the business is digital versus non-digital may vary from business to business but there’s not a single business that’s 100% non-digital.
In the Indian context, this is so particularly after the introduction of GST.
Though it has taken time, businesses have understood the benefits of digital transformation.
The Indian market was quite reluctant to accept/embrace digital transformation, initially.
The reasons were:
Slowly but surely as a few early adopters took hesitant steps towards digital transformation and started ‘seeing’ the benefits, more and more firms followed. Today, I dare say, there are very few firms, if any, that have not been touched at all by digital transformation.
Today everybody understands that digital transformation is not only inevitable but benefits all. Firms are still evaluating their ROI and hence pace of adoption is not ideal yet.
There are obstacles and challenges, the foremost being connectivity not only in terms of speed and price, but in terms of reach. There are still many areas in the country where connectivity is very poor or non-existent .
Technologies like 5G and other indigenous technologies and solutions, will hopefully, address this issue.
In my opinion the most important barrier is culture. The culture in each geography is unique and the sooner companies understand the local culture the better for them. The next important challenge is to understand the local laws, business environment. There could be challenges in effective communication besides language differences. The pace at which things move, including the pace of business negotiations can vastly vary. Distance and time could be a challenge, too. Finding and hiring people who are trustworthy and competent can be a challenge. Establishing franchises, signing up agents and other business associates may take longer than what companies ‘back home’ are used to
The very first challenge was not being able to register a domain name, from India.
(Internic was the only share registry and for registering any domain one had to pay $100; the only way to pay was online; this was not possible from India. I had to take the help of my sister in US, who paid this $100 and we registered chennaionline.com on Aug 15, 1997.)
One of the foremost challenges for a start up in a sunrise industry, which the online space was, way back in 1997, was getting the right people to come on board. We leaned on friends and other contacts to get the initial few hires.
The next challenge was funding –VC/Angel funding culture, back then, was literally nonexistent. Raising capital as equity was very difficult if not impossible. Debt funding or in Indian parlance, a bank loan was the only option.
Banks lend against tangible assets – land, building, plant & machinery – and also insist on security for the loan. Here was a business that had no tangible assets (except some PCs and servers and switches and modems – assets that depreciated faster than the mercury rising in Chennai summer) and a business model that was at best vague (actually from the bank perspective, it was all Latin and Greek).
The Bank Manager, professed he understood nothing, but said he was impressed with my sincerity of purpose and sanctioned the loan. (“As a breed we are risk averse, but if we do not take some risk to support highly qualified technocrats, when we get an opportunity, then we do not deserve to be sitting here”, he said!)
Though the potential of the web/online was fairly well established globally, India was slow to adopt or embrace this ‘new economy’ and hence every ‘pitch’ had to be from ‘ground zero’. One of our (founding team) important roles was to evangelise Internet& ecommerce; evangelise we did with passion and enthusiasm. This not only got us noticed but became a competitive advantage, too.
There were many more challenges including getting the right office space, etc.
There were so many Foreign Exchange rules & regulations that receiving or sending money out of India was a huge task. We did $ transactions wrestling with a plethora of forms and multiple agencies.
Certainly not. Thanks to information/knowledge available in one click, for anyone, and the more business friendly environment, many of the earlier day business challenges do not exist. However, each new firm (or old firm) has a unique challenge. It is much like a baby’s growth – from conception to infancy to childhood to adolescence to adulthood – at every stage in the life of a firm there are unique challenges. A successful firm is one which understands this and also understands every challenge is a possible opportunity.
AR/VR’s immense potential in the field of Education is picking up with several colleges inculcating it in their activities. A snapshot of how technology has added value to what they do:
How does a player train at a centre on par to the field experience without having to visit one? That is where VR came-in handy for the students and faculty at the Iowa State University.
The University’s football coaches collaborated with the Virtual Reality Applications Center to recreate a live match effect just like at Jack Trice stadium to help players train.
The virtual action takes place in the C6, an immersive VR environment in the VRAC. The players wear a VR headset and practice in a live stadium setup with virtual opponents. This enabled students to place themselves in the centre of action.
We might just be few steps away from an actual teleporting facility. In the virtual world, one can place themselves on the other side of globe at the touch of a button.
People at SCAD have done just that, sending out Google Cardboards to 30,000 of their recruits last year, enabling them to view their campuses across the globe. The excitement of the students to view their home for next few years and the parental concern of where their ward will be resolved at the touch of a button.
Utilizing the other fruits of VR, the university took to AR to provide enhanced course catalog with AR videos and animations that aided course study for several students.
VR campus tours have become tech fad at most universities. Texas A&M University unveiled immersive 360-degree VR tours at SXSW in March, showing how VR aides as a recruitment tool. The VR tours also relieve the management and students of having to work a mutually agreed date and time of tour as it enables tours from anywhere, anytime the student wants. Furthermore, the virtual tours provide a much-detailed over view of all the aspects in a campus as opposed traditional walk-in basic over-view.
Embrace excellence in the field of Education, setup your own AR/VR facility at just one click.
Based on an article that was first published in Edtechmagazine.com
A peek into some of the trends that Gartner has identified for 2018:
Almost two decades since the millennium, the evolution of intelligent technology has reached a stage where Augmented and Virtual Reality has become accessible reality.
AI is set to feature on all digital platforms, apps or device this year, a trend that saw a boom last year.
AR/VR acts as the merger for multiple stand-alone technological things to an immersive technology, using the best of both worlds. Along with some conversational platforms, AR, VR, and MR will bring a fundamental shift to user experience, resulting in an immersive experience.
For example: From ‘Googling’ on specific information manually to just scanning an object and getting complete information on the object in front of us.
Appearition adds the ‘human’ element to AR/VR. ‘VR will change the way we shop, travel, learn and even create an informative platform in healthcare. AR/VR will create an immersive brand awareness changing the way businesses market,’ says Vivek Aiyer, Founder and CEO, Appearition.
AI will run unobtrusively in the background of many familiar application categories while giving rise to entirely new ones, predicts Gartner. For example, AR combined with analytics in a machine/app automates data preparation, insight to share with a broad business user and operational workers.
These twins are digital ‘soft-copies’ of a real-world entity or system. A Gartner study says, with an estimated 21 billion connected sensors and endpoints by 2020, digital twins will exist for billions of things in the near future.
This aspect of technology will come in handy while studying or manufacturing heavy machinery, construction and to a great extent in healthcare. By overlaying digitally-created content into real-world environment, it enables everyone to view a replica of the project and sharing an almost-actual insight.
For example, Digital Twins can be created for an internal organ, so that one can view exactly where and what procedure they are expected to go through medically.
Watch this space for exciting AR/VR/MR/AI related content!
Reference: Gartner – Top Tech trends for 2018
It is common knowledge that as technology evolves, individuals are becoming more informed and driven to create content aligned to their passions. Think about the content you are seeing in your social feeds – your colleague’s oddball memes, Aunt Sue with puppy’s ears and your old school mate Trevor Lam and his latest “work of art” – everyone around us is getting more and more able to express their creativity and publish it too. Facebook Augmented Reality (AR) is going to allow people to express themselves a whole lot more.
Give everyone the power to share anything with anyone.
– Mark Zuckerberg
What is F8 – and why should you care?
The Facebook Developers conference (F8) was first hosted in 2007 – where the team at FB presented the social graph – or a rendition of the concept of a social network. Subsequent editions of F8 hosted similarly theoretical principles behind the evolution of the behemoth that FB is today. Essentially, this is the conference where they announce their next plans, and given how integrated FB is in our lives today – you might want to be aware of what’s ahead.
F8 2017: Facebook Augmented Reality
Earlier this week, at F8 2017, Mark Zuckerberg (Zuck!) shared an update on the next phase of FB’s 10-year product plan, originally shared in at F8 2016. Commencing with some warm up jokes about the release of Fast and the Furious 8 (the “other” F8 ) this week, Zuck proceeded to give us a snapshot of how FB plans to integrate AR into camera functions in their apps.
Mark Zuckerberg’s keynote from Day 1 of F8
FB, AR & Cameras – how do they come together?
In recent times, the FB family of apps (FB, Messenger, Instagram & Whatsapp) have seen the integration of camera icons across the board – enabling functions such as video conferencing. While these changes have gone unnoticed by some, it is estimated that the FB messenger app has 1.2 billion monthly users.
FB Messenger with camera Icon (Source: Forbes)
And how does AR fit into this equation?
Zuck went on to share a common understanding that AR is essentially used for three key purposes;
Facebook Augmented Reality will work by aggregating these tools – the cameras within FB apps will allow users to create AR “experiences” – and they will seem quite familiar once you see them. AR is not rare – we’ve all seen it in one form or the other – quite possibly most recently in the form of Pokemon Go.
Now, we all know that Pokemon Go was a huge driver in bringing AR to the mainstream – even if it was little more than a temporary fad for most. You’ve also undoubtedly heard us go on about how the popularity of the game was influential in the voluminous cash injection industry players received in 2016. But this could very well be, to quote Led Zeppelin, when the levee’s gonna break.
Where might you have seen AR in action?
Some use cases we’ve found interesting
So how does it all work exactly? (A splash of technical jargon)
This vision comes to life with the incorporation of some technological building blocks;
What about Virtual Reality?
AR and Virtual Reality align quite well, and in that vein, FB is launching a platform called Facebook spaces – where you can interact with people in a virtual environment through the Oculus Rift.
Facebook spaces (from F8 2017)
Meanwhile, we’ve been doing our own experiments with the Rift too!
Early days in terms of adoption – and the plan for an open platform
Zuck reiterated a key message around AR: It is yet in a rudimentary phase of development – and most of the use cases around us are still evolving too. Don’t expect the world to change overnight.
That being said, in offering an open platform and leveraging the huge universe that lives on FB – users will be able to create AR experiences on their own, and share them online. In doing so, new users will have access to parallel creations by fellow users from around the internet.
This spike in available content will invariably help everyone around us find AR experiences that fit their fancy – especially if this punt from FB is a good one – and at Appearition, we certainly believe Facebook Augmented Reality is going to be something special for all of us.
TV is old news, mobile is now, but AR is the next big thing
AR is truly magical. As such, it appeals remarkably strongly to young people.
Interested in 360 VideoSphere (360 Virtual Reality)? This series shares what I learnt producing a short film aboard an old Sailing Ship for the Melbourne Fringe Festival.
In the last update, my team of volunteers were looking forward to shooting our first 360 VR short film. Then we hit a hurdle. Our cinematographer was unable to do any test shots or editing, due to incompatibility with his computer and the festival’s practice camera.
The hurdle was followed by a face-first tumble into the mud when our sound engineer had an overseas job at the same time as the shoot. We could not reschedule; Melbourne Regatta Day aligned with our shooting window, and was too good to miss.
Plan B. We contacted other specialists, and they were keen to try 360 VideoSphere production, but there was not enough time to line up people and equipment. So we fell back to Plan C; use the Samsung Gear 360 camera’s inbuilt microphone. This would not be great if you’re recording a concert, or producing a narrative that requires directional sound to direct audience attention. Still, for our purposes we were pretty pleased with the quality.
Conventional wisdom with emerging technology is test it early and iron out the inevitable problems. It’s wisdom for a reason.
Unfortunately, the festival’s production units were unavailable in advance. So, we could give up, or improvise and manage the risk. We decided to go for it, and as expected, encountered problems right away.
It is not possible to get behind a 360 camera and look through a viewfinder, but with the Samsung Gear you can use your phone as a remote viewer. A nifty feature, unless as in this case, Samsung block access to the app because you’re in a country where the Camera has yet to be officially released. The festival hadn’t identified this issue because like us, this was their inaugural spin on the 360 dancefloor.
Short of trying solutions like IP masking to make it look like we were in South Korea (where the camera was bought) we would have to shoot blind – so that’s what we did. For example, we climbed the mast and out onto a yardarm to attach the camera. Then, we recovered it after 10 minutes to physically connect it to my laptop and review the footage.
Sometimes even workarounds need a workaround. The case around the camera’s USB port was too small for our cable, and modifying the borrowed camera was out of the question. Our resident inventor, Andrew, borrowed the skipper’s knife and whittled away his own USB cable’s superfluous housing. I admit, I was sceptical but it fit neatly into the Camera’s port.
So after a long day shooting we had plenty of good footage.
However, 360 VideoSphere (360 VR) film is captured on multiple cameras. So, this composite footage must be “stitched” together before it can be edited. The results create some unique trials in the editing suit!
For an immersive experience and ease of use try using a Google Cardboard headset and selecting this icon in YouTube:
Interested in 360 VR (VideoSphere)? This series shares what I learnt producing one aboard an old Sailing Ship for the Melbourne Fringe Festival.
I was lucky enough to come across the opportunity at a VR (Virtual Reality) meetup to produce a VideoSphere short film, with the camera and expert guidance supplied. I have produced traditional video, and was already intrigued after seeing two staff from ABC TV talk about their experience at an earlier Mixed Reality meetup.
When Amy Nelson and Astrid Scott explained how they produced the ABC’s first 360 production, I was struck by how accessible they made it. They faced the challenge of placing their camera on a pole over an angry bull in the middle of a rodeo in outback Queensland. For other shots they had the camera operator hiding behind a barrel. Not because of the bull, but because hiding the crew behind the camera is not an option, when there is no “behind” the camera.
They were candid about accepting mistakes. They knew that many of the rules learned over the last century do not apply to this medium so new practices must be developed through experimentation.
So given this chance, my first thought was ‘brilliant!’ which is my reaction to anything related to Virtual and Augmented Reality. But I had no team, no 360 experience, and no time. So, it had everything going for it but common sense.
The festival required a proposal. Cultural Heritage (i.e. history) kinda rocks and everybody loves old fashioned sailing ships, whatever their opinion of Johnny Depp’s (over)acting in Pirates of the Caribbean. However, not everybody can spend time aboard one, let alone to climb out onto a yard-arm high above the deck. I have been a volunteer aboard the Enterprize, an educational tourism ship, for the last few years, and this was a way to share the experience.
The first step was to create a storyboard (a sequence of shots, like panels in a comic book) and get the festival and the ship’s management on board.
The next step was to put together a team. For the cinematography I called on Andrew Gotts, an old friend who has worked in video production. He enjoys experimental technology, and has a good head for heights. He suggested an editor, Nadia Nusatea, so that made three. We still required an audio specialist so I approached Darius Kedros who runs a VR Audio special interest group.
There were a few short weeks to learn the technology, shoot and edit. But we now had a plan, a team, and something to film.
Then, bad news. The practice camera provided was incompatible with Andrew’s hardware, and we could not borrow the production camera until less than a day before the shoot. Our choices were to quit, or go in blind.
Worse news. Darius would be overseas for an extended period. Understandably he did not want to risk his very expensive audio capture equipment with somebody else; particularly when it would be suspended over salt water.
In next week’s edition: All At Sea But Problem Solving: We improvise to solve our production problems and capture our footage, but even editing 360 creates its own obstacles
Many of these are Melbourne (Australia) based, but you can find similar resources wherever you are.