Inventor · disambiguated record
Nicolas Manfred Otto Heess
Also filed as: HEESS NICOLAS MANFRED OTTO
22 granted patents·12 pending applications·55 citations·filing 2009–2024
93Inventor score
Top patents by PatentIndex Score
34 records- 0192US11210585B1Selecting reinforcement learning actions using a low-level controllerDEEPMIND TECH LTD·Filed 2017·Granted Dec 28, 2021·16 cites·18 claims
- 0291US11803750B2Continuous control with deep reinforcement learningDEEPMIND TECH LTD·Filed 2020·Granted Oct 31, 2023·5 cites·20 claims
- 0388US10632618B2Neural networks for selecting actions to be performed by a robotic agentDEEPMIND TECH LTD·Filed 2019·Granted Apr 28, 2020·4 cites·20 claims
- 0487US11132609B2Multi-task neural network systems with task-specific policies and a shared policyDEEPMIND TECH LTD·Filed 2019·Granted Sep 28, 2021·7 cites·27 claims
- 0584US10664725B2Data-efficient reinforcement learning for continuous control tasksDEEPMIND TECH LTD·Filed 2019·Granted May 26, 2020·5 cites·22 claims
- 0679US2025094772A1Training action selection neural networks using off-policy actor critic reinforcement learning and stochastic dueling neural networksDEEPMIND TECH LTD·Filed 2024·Application pending·0 cites
- 0777US12367391B1Selecting reinforcement learning actions using a low-level controllerDEEPMIND TECH LTD·Filed 2023·Granted Jul 22, 2025·0 cites·20 claims
- 0877US12190223B2Training action selection neural networks using off-policy actor critic reinforcement learning and stochastic dueling neural networksDEEPMIND TECH LTD·Filed 2020·Granted Jan 7, 2025·1 cites·20 claims
- 0977US10776692B2Continuous control with deep reinforcement learningDEEPMIND TECH LTD·Filed 2016·Granted Sep 15, 2020·4 cites·20 claims
- 1075US12346786B2Data-efficient reinforcement learning for continuous control tasksDEEPMIND TECH LTD·Filed 2023·Granted Jul 1, 2025·0 cites·11 claims
- 1175US11868882B2Training action selection neural networks using apprenticeshipDEEPMIND TECH LTD·Filed 2018·Granted Jan 9, 2024·3 cites·20 claims
- 1275US10706352B2Training action selection neural networks using off-policy actor critic reinforcement learningDEEPMIND TECH LTD·Filed 2019·Granted Jul 7, 2020·2 cites·22 claims
- 1369US11875258B1Selecting reinforcement learning actions using a low-level controllerDEEPMIND TECH LTD·Filed 2021·Granted Jan 16, 2024·0 cites·21 claims
- 1467US11886997B2Training action selection neural networks using apprenticeshipDEEPMIND TECH LTD·Filed 2022·Granted Jan 30, 2024·0 cites·20 claims
- 1566US10776670B2Imagination-based agent neural networksDEEPMIND TECH LTD·Filed 2019·Granted Sep 15, 2020·1 cites·17 claims
- 1665US11983634B2Multi-task neural network systems with task-specific policies and a shared policyDEEPMIND TECH LTD·Filed 2021·Granted May 14, 2024·0 cites·20 claims
- 1765US11534911B2Neural networks for selecting actions to be performed by a robotic agentDEEPMIND TECH LTD·Filed 2020·Granted Dec 27, 2022·0 cites·21 claims
- 1865US8229221B2Image processing using masked restricted boltzmann machinesLE ROUX NICOLAS·Filed 2009·Granted Jul 24, 2012·7 cites·20 claims
- 1964US12343874B2Reinforcement and imitation learning for a taskDEEPMIND TECH LTD·Filed 2023·Granted Jul 1, 2025·0 cites·20 claims
- 2064US11741334B2Data-efficient reinforcement learning for continuous control tasksDEEPMIND TECH LTD·Filed 2020·Granted Aug 29, 2023·0 cites·19 claims
- 2162US11328183B2Imagination-based agent neural networksDEEPMIND TECH LTD·Filed 2020·Granted May 10, 2022·0 cites·20 claims
- 2259US2021089834A1Imagination-based agent neural networksDEEPMIND TECH LTD·Filed 2020·Application pending·0 cites
- 2356US2024412072A1Neural population learningDEEPMIND TECH LTD·Filed 2024·Application pending·0 cites
- 2455US10860895B2Imagination-based agent neural networksDEEPMIND TECH LTD·Filed 2019·Granted Dec 8, 2020·0 cites·20 claims
- 2555US2024220795A1Planning using a jumpy trajectory decoder neural networkDEEPMIND TECH LTD·Filed 2023·Application pending·0 cites
- 2654US2025348749A1Learning tasks using skill sequencing for temporally-extended explorationDEEPMIND TECH LTD·Filed 2023·Application pending·0 cites
- 2751US2024311617A1Controlling agents using sub-goals generated by language model neural networksDEEPMIND TECH LTD·Filed 2024·Application pending·0 cites
- 2850US2024403652A1Hierarchical latent mixture policies for agent controlDEEPMIND TECH LTD·Filed 2022·Application pending·0 cites
- 2945US2020090042A1Data efficient imitation of diverse behaviorsDEEPMIND TECH LTD·Filed 2019·Application pending·0 cites
- 3045US2019126472A1Reinforcement and imitation learning for a taskDEEPMIND TECH LTD·Filed 2018·Application pending·0 cites
- 3141US2022366245A1Training action selection neural networks using hindsight modellingDEEPMIND TECH LTD·Filed 2020·Application pending·0 cites
- 3240US2023214649A1Training an action selection system using relative entropy q-learningDEEPMIND TECH LTD·Filed 2021·Application pending·0 cites
- 3339US2022237488A1Hierarchical policies for multitask transferDEEPMIND TECH LTD·Filed 2020·Application pending·0 cites
- 3438US12499359B2Graph neural networks representing physical systemsDEEPMIND TECH LTD·Filed 2019·Granted Dec 16, 2025·0 cites·17 claims
Join the waitlist — get patent alerts
Get an alert when Nicolas Manfred Otto Heess files or is granted a new patent.
We store only your email — no account needed. See our privacy policy.
Identity basis: PatentsView inventor disambiguation (2025Q4-odp release). How scoring works →