DAG: multi_interest_2024_dag flow for multi-interest modeling

schedule: 10 03 * * *


DAG details

None 5 removed 47 success 11638

schedule_interval 10 03 * * *
start_date None
end_date None
max_active_runs 0 / 16
concurrency 16
default_args {'owner': 'Terry', 'depends_on_past': False, 'start_date': <Pendulum [2023-12-08T00:00:00+00:00]>, 'email': ['tian23.li@tcl.com'], 'email_on_failure': True, 'email_on_retry': True, 'retries': 2, 'retry_delay': datetime.timedelta(seconds=480)}
tasks count 37
task ids ['kill_iPython_job', 'update_jx_lst_media', 'generate_user_click_data', 'get_ecpm_aids', 'update_user_click_all_channelname_60days_012468', 'update_user_click_all_channelname_60days_3579', 'generate_diffurec_dataset_all_channelname_012468', 'generate_diffurec_dataset_all_channelname_3579', 'get_pretrained_content_embedding_jx_lst', 'get_pretrained_image_embedding_minicpm', 'pca_text_image', 'train_diffurec', 'get_pretrained_content_embedding_sep', 'get_pretrained_image_embedding_minicpm_sep', 'pca_text_image_v2', 'train_llm_diffurec_v2', 'generate_inference_dataset_012468', 'generate_inference_dataset_3579', 'generate_diffurec_recall_result_2468', 'generate_diffurec_recall_result_3579', 'get_pretrained_content_embedding_vip', 'get_pretrained_image_embedding_minicpm_vip', 'generate_diffurec_dataset_all_channelname_vip', 'pca_text_image_vip', 'train_diffurec_vip', 'generate_inference_dataset_vip', 'generate_diffurec_recall_result_vip', 'save_recall_to_hive', 'save_user_click_seq_to_hive', 'update_text_embedding', 'update_content_embedding', 'update_jx_feed_media', 'update_jx_feed_media_v2', 'update_content_embedding_jx_feed', 'generate_inference_dataset_i2i', 'generate_diffurec_recall_result_i2i', 'update_jx_lst_media_v2']
filepath multi_interest_2024.py
owner Terry