news & Things

Next Gen AI That Can ‘Think Of Itself’ Being Developed By Facebook

news & Things
wooden toy

15th Nov 2021

Current AI’s are terrible at understanding a first-person point of view… Facebook’s next gen AI will change all of that.


Despite popular opinion, AI software has no sense of ‘self’ and is unlikely to do so any time in the near future. However…

Facebook have just announced that they are hoping to build an AI system capable of taking an ‘egocentric’ view of the world.


The plan is for future AI programs to be capable of taking a more ‘human’ view of the world by learning from more first-person shot imagery and video that centres the cameras view firmly in, well, the centre.

As simple as that may sound, Facebook hope it will unlock unthought of potential to enhance AR (augmented reality) tools alongside wearable tech… For instance, your glasses could scan a room and find your car keys if you can’t see them.


Facebook are working on exactly that in conjunction with thirteen other universities and labs across nine countries on Ego4D, a long-term project they are funding without any outside help. So far Project Ego4D has collated over 2,200 hours of first-person video from over 700 participants just going about their daily lives.

Project Ego4D has been tasked with five developmental benchmarks for developing the next gen of AI:


  • Episodic memory: What happened when? (e.g., “Where did I leave my keys?“)
  • Forecasting: What am I likely to do next? (e.g., “Wait, you’ve already got your keys“)
  • Hand and object manipulation: What am I doing? (e.g., “Putting the keys in the car“)
  • Audio-visual diarisation: Who said what when? (e.g., “What was the main topic during class?”)
  • Social interaction: Who is interacting with whom? (e.g., “Help me better hear the person talking to me at this noisy restaurant”)


All of the above play right into the rumours that Facebook, owners of Oculus VR, are planning on launching their own branded smart glasses soon.

We expect that to the extent companies use this dataset and benchmark to develop commercial applications, they will develop safeguards for such applications. For example, before AR glasses can enhance someone’s voice, there could be a protocol in place that they follow to ask someone else’s glasses for permission, or they could limit the range of the device so it can only pick up sounds from the people with whom I am already having a conversation or who are in my immediate vicinity. – Facebook Spokesperson


More news & Things

More news & Things

James Crossland in Tech

400% Increase In Microsoft Teams Usage: Can This Bridge The Gap Between Frontline Workers & Their Managers?

Microsoft recently made changes to its Teams and Viva platforms ahead of the February 1st Cloud For Retail general availability – and published a report alongside the changes which outlines the challenges frontline workers are facing in 2022. According to Jared Spataro (Microsoft’s CVP for Modern Work), Microsoft defines a frontline work as “folks who […]


Ukraine Target Of Sustained Hacking: Early Reports Point The Finger At Russia

Cyber Actors threatened citizens with the publication of their private data A number of government websites in the Ukraine recently came under fire from a sustained hacking attack on the 13th of January, which involved cyber attackers distributing menacing messages which appear to be aimed at intimidating Ukrainian citizens. A Facebook post by the Ministry […]


West Mids Transport Chiefs Have Agreed Priorities For A £1.3bn Investment In The Region

A list of preferred priorities and schemes will now be submitted by the combined authority to the Department for Transport for final approval.   That £1.3bn of investment will be spent on over fifty different transportation improvement projects within the West Midlands, with a full list to be published as soon as the DoT have […]


UK Government Removes Community Wealth Fund Amendment From Upcoming Bill

The UK Government have just removed an amendment from the upcoming Dormant Assets Bill that would allow for the creation of Community Wealth Funds… however acknowledged  there was a lot of widespread support for the concept.   The amendment, previously added by the House of Lords, was removed in the House of Commons during its […]

James Crossland in Non-Profit

Wales Has An Additional Duty To Climate Change Due To Its Coal Mining Past – Conservationist Claims

Leading Welsh NonProfit conservationist claims Wales has a ‘particular responsibility’ to help fight climate change due to its coal mining history.   Ru Hartwell, director of NonProfit Carbon Link, has recently been quoted as saying Wales ‘invented’ a model for industrial development based almost exclusively on exploiting fossil fuels.   Carbon Link runs a tree-planting […]

Chloe Smith in NonProfit

What Happens Once the Small Charities Coalition Closes Its Doors For Good?

A breakdown of what the closure of the membership body means for the more than 16,000 organisations it serves, and what the sector needs to consider following its impact. Small Charities Coalition announced in December that lack of funds has meant it will close in spring.   [We have] exhausted all possibilities to secure funding […]

Send us a Message

    Call cloudThing
    0121 393 4700
    By pressing send you agree to our Terms & Conditions