General Notes, Ideas, and Thoughts
Ideas (add them at aisi.ai/list/ai-governance where you can also indicate interest)
- Jaime: Create a database of up-to-date documents related to Governance in the EU
- Jaime: The European Commission intends to track metrics such as the number of incidents in absolute terms, as a share of deployed applications and as a share of EU citizens affected by harm, in order to assess the effectiveness of the AI Act. ⇒ one option could be to develop an independent database of AI incidents (example here) to flag when and why incidents violate the EU AI Act
- Jaime: there seems to be a focus on transparency so maybe a writing:
- could push up governmental funding towards (mechanistic) interpretability.
- OR compare the “transparency” of other technological developments regulated by the EU to show that current AI is too opaque, so there should be a strong focus on the EU pushing towards transparency
- OR distinguishing different levels of “transparency” from 100% whitebox to 100% blackbox. Highlighting were current AI Systems (chatGPT, Llama2, …) fall and trying to map that to the risk levels of the EU AI Act.
- Jaime: there seems to be grey areas around the regulation of “Open Source”. The definition of “Open Source” itself is particulary vague when it comes to LLMs (open weights, open models, open training data, …) so one option would be to create a taxonomy with different levels of “Open Source” in LLMs/generative-AI-systems and offer a mapping to the current risk levels in the EU AI Act
Key considerations for the weekend's project
- Heramb: Must be clear, with considerations for different cases
- Heramb: within the scope and interpretation of the act
Notes from the breakout session
- Heramb:
focus on x risk? who is the audience?
- Heramb: might be good to reverse engineer this (read act first then build on readings thru standards or past literature)
- read other implementation guidelines from the EU?
Overview and Resource Notes
The EU AI Act is one of the most ambitious legislations for AI at the moment. During the implementation stages of the next two years, it is important that we understand how the legislation affects various actors in the space of AI.
Take notes in the foldout