Webserver Error: Broken Plugin No Module

428 views
Skip to first unread message

Alexander Janakos

unread,
Jul 28, 2022, 6:20:42 PM7/28/22
to cloud-composer-discuss
Hello,

Previously, we were using Composer v1 with no issue loading our plugins. Once we migrated to Composer v2, I noticed the webserver complaining like so:

Broken plugin: [/home/airflow/gcs/plugins/operators/gcs_to_elasticsearch.py] No module named 'helpers'

While running our dags, everything is working just fine with the plugins, but we're stuck with several big red errors on our webserver landing page.

Directory Structure
plugins/
dags/
    helpers/
    dag_1.py

Any help would be very much appreciated,
Alex

Max M

unread,
Aug 15, 2022, 7:10:09 AM8/15/22
to cloud-composer-discuss
Hi Alex, hi all

we have a similar problem. Our plugins have problems to load some classes from /dags folder. We have also used Composer v1 and upgraded to v2. Our dags are also working fine, but it looks weird in the Airflow UI. On the other hand, our dag folder loads all plugins without showing errors in the UI. We are using Composer-2.0.22-Airflow-2.1.4

Directory Structure
dags/
plugins/
    sensors/
          sensor.py

Kind regards,
Max

Max M

unread,
Aug 15, 2022, 8:32:20 AM8/15/22
to cloud-composer-discuss
Hi Alex, hi all,

sorry for confusing I mean that the Airflow UI shows us a similar Broken Plugin message, but the Plugin is working fine. It's the similar case like the one from Alex.

Kind regards,
Max

Reply all
Reply to author
Forward
0 new messages