Internship AI and Embedded System - 6 months

Job description

ABOUT TELECOM SUDPARIS

Telecom SudParis is a public graduate school for engineering, which has been recognized on the highest level in the domain of digital technology. The quality of its courses is founded on the scientific excellence of its faculty and on teaching techniques that emphasize project management, innovation and intercultural understanding. Telecom SudParis is part of the Institut Mines-Telecom, the number one group of engineering schools in France, under the supervision of the Minister for Industry. Telecom SudParis with Ecole Polytechnique, ENSTA Paris, ENSAE Paris and Telecom Paris are co-founders of the Institut Polytechnique de Paris, an institute of Science and Technology with an international vocation.

Its assets include: a personalized course, varied opportunities, the no.3 incubator in France, an ICT research center, an international campus shared with Institut Mines-Telecom Business School and over 60 student societies and clubs.


 CONTEXT

Nowadays, the electric energy resource management is a real concern. Many connected objects, smartphones and computers are surrounding us, and of course, they need a certain amount of electric energy to operate. For an efficient use, predicting the electric consumption in a building will contribute to an optimal energy production in various climate conditions. This fits fully the smart cities and grids, which are currently an enthusiastic research area.

Various works have been carried out in order to model and predict the energy consumption as it could have been done for a building. Recent results [1] show that Artificial Intelligence (AI) algorithms based on Long Short Term Memory (LSTM) Neural Networks (NN) present a minimal error in energy prediction. It seems clearly that AI algorithms will contribute in the energy resource management.

These AI algorithms rely on the collection of a long-term data history of the electric consumption and some associated meteorological data. Consequently, this huge amount of data requires important computational and network resources, as routing algorithms, to establish the prediction and send data, leading to an additional energy consumption since cloud-based computers will be involved. Practically, Graphic Processor Unit (GPU) cards, lot of memory and a communication network are required to train and deploy the AI model.

To overcome this issue, low cost small embedded systems can play an important role in predicting energy in different climate context when working in harmony. Typically, these small systems are based on a microcontroller and present an interesting trade-off in terms of computation power, energy consumption, programming flexibility, size and low cost.

Classically, the NN model parameters, named weights, are determined using the well-known BackPropagation (BP) algorithm, requiring a high computing power. When compared to a computer, a microcontroller includes a limited resources processor and few amount of data and program memories. For this reason, the AI model is first trained and tested using a computer (associated to a GPU). Then, in a second time, a compression / optimization and a computational complexity decreasing are applied on the model in order to be deployed on the small embedded system [2]. This is performed by reducing the model parameters number and by using an efficient bit quantization (floating to fixed-point conversion) without degrading too much the accuracy [3]. Moreover, interesting work [4] have been done in order to perform the BP algorithm on the embedded system. Another interesting and promising solution is the Transfer Learning (TL) approach, as described in [5, 6]. It is a well-suited technique to train and deploy a NN on a small embedded system and fully autonomous.


ACTIVITIES

The objective of this work is to implement AI algorithms, including the training step, on small embedded systems, based on microcontroller, for electric energy consumption time series prediction, and in a distributed manner.

Database should include meteorological data from the available station at the "Plateau de Saclay". The association of adapted routing algorithms would allow the communication between these distributed IoT nodes.

This could be carried out by:

- Adapting AI algorithms, including the backpropagation algorithm, to limited resources embedded system.

- Study the weight quantification effect on the prediction accuracy.

- Study resilience and cooperative learning on several circuits (several nodes working in a distributed manner).


REFERENCES

[1]: A. Dridi, H. Moungla, H. Afifi, J. Badose, F. Ossart and A. E. Kamal, "Machine Learning Application to Priority Scheduling in Smart Microgrids", International Wireless Communications and Mobile Computing (IWCMC), 2020.

[2]: P. Warden & D. Situnayake, "TinyML: Machine Learning with TensorFlow Lite on Arduino and Ultra-Low-Power Microcontrollers", O'Reilly Media, Inc, 2019.

[3]: https://developer.arm.com/solutions/machine-learning-on-arm/developer-material/how-to-guides/converting-a-neural-network-for-arm-cortex-m-with-cmsis-nn/single-page

[4]: F. Ortega-Zamorano, J. M. Jerez, D. Urda Munoz, R. M. Luque-Baena and L. Franco, "Efficient Implementation of the Backpropagation Algorithm in FPGAs and Microcontrollers", IEEE Transactions on Neural Networks And Learning Systems, Vol. 27, N° 9, september 2016.

[5]: S. J. Pan and Q. Yang, "A survey on transfer learning", IEEE Transactions on Knowledge and Data Engineering, Vol. 22, N° 10, 2010.

[6]: A. Dridi, H. Afifi, H. Moungla and C. Boucette, "Transfer Learning for Classification and Prediction of Time Series for Next Generation Networks", IEEE ICC, 2021.

Job requirements

Level of training required

  • Engineer or Master 2 in progress

Required skills and knowledge :

  • Programmation C/C++
  • Python
  • Basic microcontroller knowledge
  • Interest in physics, electronics and artificial intelligence

Skills and abilities :

  • Rigour, project management methods
  • Good interpersonal skills with people at all levels and a spirit of cooperation
  • Ability to work in a team
  • Curiosity for new technologies

Further information and application

  • Deadline for application: December, 31st 2022
  • Type of contract: Internship 6 months
  • Location of the position : Palaiseau (91), France
  • The positions offered for recruitment are open to all, with accommodations for candidates with disabilities upon request
  • Working conditions : on-site restaurant and cafeteria, accessibility by public transport or close to main roads, staff association and sports association on campus
  • Contact persons : Ghalid ABIB (ghalid.abib@telecom-sudparis.eu)