ACAI 2024
INTERNATIONAL CONFERENCE
ON ADVANCES IN COMPUTING TECHNOLOGIES
AND ARTIFICIAL INTELLIGENCE
ON ADVANCES IN COMPUTING TECHNOLOGIES
AND ARTIFICIAL INTELLIGENCE
07 - 13 JULY 2024
MOROCCO
The conference will be held for the fourth time and will bring together leaders from industry and academia to discuss technological advances, research results and applications in artificial intelligence methods and technologies, as well as advanced computational algorithms.
The conference will provide a valuable opportunity for researchers and industry experts to exchange ideas face to face. We have a strong organizational team, stable reputation and reliable sponsors worldwide.
During this conference the following directions will be covered:
AI inference: In practical production environment, it is needed to serve multiple large models on multiple devices. Explore the key challenges in the inference serving system for achieving best latency and throughput. Discuss the latest trend for new large models including Sora, Jamba etc. By exploring the architecture of them, the key challenges for the accuracy and inference performance for future large models are to be observed. Introduce the key challenges on fusing heavy kernels (GEMM and Conv with other elementwise kernels) automatical code gen for heterogeneous devices like NPUs.
AI algorithm: Diffusion models have shown remarkable success in the fields of image synthesis and related generative tasks. Reduce the inference cost of the diffusion model and improve the throughput by using the quantization and inference acceleration algorithm. Large model tuning is a key step to enable customers to develop large model applications. Propose a novel methodology that continues advances in this field by introducing backpropagation-less method for updating re-parametrized weights.
Residual Number System (RNS): In this talk the basics of RNS and its applicability to Neural Network inference and training will be covered. The problem of RNS applicability to the floating-point arithmetic is being explored, as well as the latest approaches related to division in RNS. In this talk novel math approaches (e.g. Residue Number System) for the computing hardware architectures will be explored targeting hardware costs and power consumption reduction. Highlight hardware optimization techniques related to math arithmetics implementation in the computing hardware.
Performance tools: Introduce the important features on the performance analysis tools, and to discuss how to extend the metrics to help the scenario performance analysis like virtualization.
DBI: Roofline analysis is powerful instrument, which can compare application performance against hardware capabilities, find out which level of system degrades application performance of and suggest the profitable optimization techniques.
Parallel runtime: Introduce a family of memory allocation libraries including serial and parallel allocators optimized to different size classes, page sizes, micro architectures, compliant (or not compliant) to C99 and C11 standards.
GCC: Discuss optimization opportunities for GCC. Discover methodology of performance findings and related problems. Vision of modern compiler optimizations.
Math library: Modern CPU architectures have tremendously more core count and deeper compute/latency/bandwidth disbalance. Providing scalable linear algebra solvers need efforts in frameworks, algorithms, tools, and many more. In large clusters, communication latency/bandwidth characteristics are largely heterogeneous. Exploiting the topology are the key for efficient distributed sparse solvers.
Welcome to Morocco
MOROCCO
2024
2024
Country in the north-west of Africa.
In the north, the country's shores are washed by the calm and warm Mediterranean Sea, in the west - by the rough and cool Atlantic Ocean. Morocco is separated from Europe by only 14 kilometers.
Along the coast stretches picturesque coastal plains with tangerine groves and vineyards, forests and agricultural land. But most of the country is mountainous (25% of the territory) and desert (50%).
The climate on the coast is subtropical, with hot summers and mild winters.
The capital of Morocco is Rabat. The largest city is Casablanca. The official languages are Arabic and Tamazight. The form of government is monarchy. The traditional religion is Islam.
In the north, the country's shores are washed by the calm and warm Mediterranean Sea, in the west - by the rough and cool Atlantic Ocean. Morocco is separated from Europe by only 14 kilometers.
Along the coast stretches picturesque coastal plains with tangerine groves and vineyards, forests and agricultural land. But most of the country is mountainous (25% of the territory) and desert (50%).
The climate on the coast is subtropical, with hot summers and mild winters.
The capital of Morocco is Rabat. The largest city is Casablanca. The official languages are Arabic and Tamazight. The form of government is monarchy. The traditional religion is Islam.
Mazagan Beach & Golf Resort, 24000 Al Jadida, Morocco
Mazagan Beach & Golf Resort is located a 20-minute drive from the town of El Jadida and is situated beside a 7 km beach. Each of the spacious guest rooms at the Mazagan Beach & Golf Resort are air-conditioned and have a contemporary design with Moroccan features. Some rooms have a view of the Atlantic Ocean. All rooms feature a private bathroom and are equipped with a minibar and a flat-screen TV with satellite channels.
Mazagan Beach & Golf Resort is located a 20-minute drive from the town of El Jadida and is situated beside a 7 km beach. Each of the spacious guest rooms at the Mazagan Beach & Golf Resort are air-conditioned and have a contemporary design with Moroccan features. Some rooms have a view of the Atlantic Ocean. All rooms feature a private bathroom and are equipped with a minibar and a flat-screen TV with satellite channels.
Please fill out the participant form
AGENDA
THE DEAD END OF DIGITAL COMPUTING
The evolution of LLMs demonstrates huge demands for Al hardware currently, but LLMs growth much faster than chip makers produce hardware. Academia (Universities) are loosing ability to research LLM since a single training may cost millions $, the initiative is borrowed by "big" companies, but... In-2-3 years the "traditional" hardware won't be able to satisfy computing demand in Al. Typical operators in Al inherit principles from biology or analogue devices, which are about signal propagation, not about 0 or 1. Exp-based activation function is computationally heavy, but can be implemented via just 2 transistors operating in analogue mode. Industry needs get back to the future and re-invent analogue computing, new transistor with controllable activation threshold is needed, humans soon invent the real Al brain.
The evolution of LLMs demonstrates huge demands for Al hardware currently, but LLMs growth much faster than chip makers produce hardware. Academia (Universities) are loosing ability to research LLM since a single training may cost millions $, the initiative is borrowed by "big" companies, but... In-2-3 years the "traditional" hardware won't be able to satisfy computing demand in Al. Typical operators in Al inherit principles from biology or analogue devices, which are about signal propagation, not about 0 or 1. Exp-based activation function is computationally heavy, but can be implemented via just 2 transistors operating in analogue mode. Industry needs get back to the future and re-invent analogue computing, new transistor with controllable activation threshold is needed, humans soon invent the real Al brain.
DAY 1 — July 8 | 2024
10:15 — 11:10
Vitaly Slobodskoy