news & Things

Next Gen AI That Can ‘Think Of Itself’ Being Developed By Facebook

15th Nov 2021

Current AI’s are terrible at understanding a first-person point of view… Facebook’s next gen AI will change all of that.


Despite popular opinion, AI software has no sense of ‘self’ and is unlikely to do so any time in the near future. However…

Facebook have just announced that they are hoping to build an AI system capable of taking an ‘egocentric’ view of the world.


The plan is for future AI programs to be capable of taking a more ‘human’ view of the world by learning from more first-person shot imagery and video that centres the cameras view firmly in, well, the centre.

As simple as that may sound, Facebook hope it will unlock unthought of potential to enhance AR (augmented reality) tools alongside wearable tech… For instance, your glasses could scan a room and find your car keys if you can’t see them.


Facebook are working on exactly that in conjunction with thirteen other universities and labs across nine countries on Ego4D, a long-term project they are funding without any outside help. So far Project Ego4D has collated over 2,200 hours of first-person video from over 700 participants just going about their daily lives.

Project Ego4D has been tasked with five developmental benchmarks for developing the next gen of AI:


  • Episodic memory: What happened when? (e.g., “Where did I leave my keys?“)
  • Forecasting: What am I likely to do next? (e.g., “Wait, you’ve already got your keys“)
  • Hand and object manipulation: What am I doing? (e.g., “Putting the keys in the car“)
  • Audio-visual diarisation: Who said what when? (e.g., “What was the main topic during class?”)
  • Social interaction: Who is interacting with whom? (e.g., “Help me better hear the person talking to me at this noisy restaurant”)


All of the above play right into the rumours that Facebook, owners of Oculus VR, are planning on launching their own branded smart glasses soon.

We expect that to the extent companies use this dataset and benchmark to develop commercial applications, they will develop safeguards for such applications. For example, before AR glasses can enhance someone’s voice, there could be a protocol in place that they follow to ask someone else’s glasses for permission, or they could limit the range of the device so it can only pick up sounds from the people with whom I am already having a conversation or who are in my immediate vicinity. – Facebook Spokesperson


More news & Things

More news & Things

James Crossland in Announcement, cloudThing

cloudThing Are Proud To Be Rebranding As Kerv Digital

Last year, cloudThing joined the Kerv Group to offer our clients even wider services, while allowing our amazing people to remain specialists and focus on what they really enjoy doing, building future.     It was a great fit right from the start as Kerv were always happy to challenge the norm and say they do things […]

Chloe Smith in NonProfit

Initiatives Underway to Improve Diversity In Environmental Workforce In The UK

Steps are being taken in the UK’s sustainability and environment professions to address the lack of diversity, as it stands less than 5% of professionals in organisations within the sector identify as being from minority ethnic backgrounds. The steps involve a data drive, asking the UK’s environmental NGOs and charities to annually report on the […]

Chloe Smith in Health Sector

Billions To Be Raised By Health And Social Care Levy, Massive Reforms To Adult Social Care Underway

COVID backlogs and reforms to adult social care underway with the Health and Social Levy implemented to raise billions. The Health and Social Care Levy has commenced from Wednesday 6th April in order to raise the billions needed for the COVID backlog, as well fund reforms to routine services. In total, £39billion will be implemented […]


NATO Identifies Emerging And Disruptive Technologies – UK To Headquarter The Defence Innovation Hub

NATO to implement the DIANA programme to maintain technological advantage: UK and Estonia to partner on the programme. Critical technologies will be seeing transatlantic cooperation, as the UK is set to be the host of the European HQ of the Defence Innovation Accelerator (DIANA), a programme set for NATO allies to accelerate, test, evaluate and […]

Chloe Smith in Transport

New Bus Scheme Set To Increase Public Transport Use by 10%

20% to 40% ticket price reduction on Cornish buses backed by £23.5m government grant A pilot of cut-fare prices has begun in Cornwall, allowing residents and visitors to enjoy cheaper prices around the far south-west of England. The county has benefitted from a ticket price reduction of between 20% and 40% to incentivise more people […]

Chloe Smith in NonProfit

Legal Proceedings Issued After National Lottery Licence Announcement

For the first time since The National Lottery started, Camelot will not be Preferred Applicant for the National Lottery licence.   A legal battle has been issued by National Lottery operator, Camelot, against the Gambling Commission after it was revealed that Allwyn Entertainment UK was its Preferred Applicant for the fourth National Lottery licence – […]