Euclid Quick Data Release (Q1) Exploring galaxy properties with a multi-modal foundation model
Year: 2025
Type: preprint
Abstract: Modern astronomical surveys, such as the Euclid mission, produce high-dimensional, multi-modal data sets that include imaging and spectroscopic information for millions of galaxies. These data serve as an ideal benchmark for large, pre-trained multi-modal models, which can leverage vast amounts of unlabelled data. In this work, we present the first exploration of Euclid data with AstroPT, an autoregressive multi-modal foundation model trained on approximately 300 000 optical and infrared Euclid images and spectral energy distributions (SEDs) from the first Euclid Quick Data Release. We compare self-supervised pre-training with baseline fully supervised training across several tasks: galaxy morphology classification; redshift estimation; similarity searches; and outlier detection. Our results show that: (a) AstroPT embeddings are highly informative, correlating with morphology and effectively isolating outliers; (b) including infrared data helps to isolate stars, but degrades the identification of edge-on galaxies, which are better captured by optical images; (c) simple fine-tuning of these embeddings for photometric redshift and stellar mass estimation outperforms a fully supervised approach, even when using only 1% of the training labels; and (d) incorporating SED data into AstroPT via a straightforward multi-modal token-chaining method improves photo-z predictions, and allow us to identify potentially more interesting anomalies (such as ringed or interacting galaxies) compared to a model pre-trained solely on imaging data.
Source: arXiv (Cornell University)
Authors: Euclid Collaboration, Siudek, M., Huertas-Company, M., Smith, M., Martinez-Solaeche, G., Lanusse, F., Ho, S., Angeloudi, E., Cunha, P. A. C., Sánchez, H. Domínguez, Dunn, M., Fu, Y., Iglesias-Navarro, P., Junais, J., Knapen, J. H., Laloux, B., Mezcua, M., Roster, W., Stevens, G., Vega-Ferrero, J., Aghanim, N., Altieri, B., Amara, A., Andreon, S., Auricchio, N., Aussel, H., Baccigalupi, C., Baldi, M., Bardelli, S., Battaglia, P., Biviano, A., Bonchi, A., Branchini, E., Brescia, M., Brinchmann, J., Camera, S., Cañas-Herrera, G., Capobianco, V., Carbone, C., Carretero, J., Casas, S., Castander, F. J., Castellano, M., Castignani, G., Cavuoti, S., Chambers, K. C., Cimatti, A., Colodro-Conde, C., Congedo, G., Conselice, C. J., Conversi, L., Copin, Y., Courbin, F., Courtois, H. M., Cropper, M., Da Silva, A., Degaudenzi, H., De Lucia, G., Di Giorgio, A. M., Dinis, J., Dolding, C., Dole, H., Dubath, F., Duncan, C. A. J., Dupac, X., Dusini, S., Escoffier, S., Farina, M., Farinelli, R., Faustini, F., Ferriol, S., Finelli, F., Fotopoulou, S., Frailis, M., Franceschi, E., Galeotta, S., George, K., Gillis, B., Giocoli, C., Gracia-Carpio, J., Granett, B. R., Grazian, A., Grupp, F., Gwyn, S., Haugan, S. V. H., Holmes, W., Hook, I. M., Hormuth, F., Hornstrup, A., Jahnke, K., Jhabvala, M., Keihänen, E., Kermiche, S., Kiessling, A., Kubik, B., Kümmel, M., Kunz, M., Kurki-Suonio, H., Boulc'h, Q. Le, Brun, A. M. C. Le, Mignant, D. Le, Ligori, S., Lilje, P. B., Lindholm, V., Lloro, I., Mainetti, G., Maino, D., Maiorano, E., Mansutti, O., Marcin, S., Marggraf, O., Martinelli, M., Martinet, N., Marulli, F., Massey, R., Maurogordato, S., McCracken, H. J., Medinaceli, E., Mei, S., Melchior, M., Mellier, Y., Meneghetti, M., Merlin, E., Meylan, G., Mora, A., Moresco, M., Moscardini, L., Nakajima, R., Neissner, C., Niemi, S. -M., Nightingale, J. W., Padilla, C., Paltani, S., Pasian, F., Pedersen, K., Percival, W. J., Pettorino, V., Pires, S., Polenta, G., Poncet, M., Popa, L. A., Pozzetti, L., Raison, F., Renzi, A., Rhodes, J., Riccio, G., Romelli, E., Roncarelli, M., Saglia, R., Sakr, Z., Sánchez, A. G., Sapone, D., Sartoris, B., Schewtschenko, J. A., Schneider, P., Schrabback, T., Scodeggio, M., Secroun, A., Seidel, G., Seiffert, M., Serrano, S., Simon, P., Sirignano, C., Sirri, G., Stanco, L., Steinwagner, J., Tallada-Crespí, P., Taylor, A. N., Tereno, I., Toft, S., Toledo-Moreo, R., Torradeflot, F., Tutusaus, I., Valenziano, L., Valiviita, J., Vassallo, T., Kleijn, G. Verdoes, Veropalumbo, A., Wang, Y., Weller, J., Zacchei, A., Zamorani, G., Zerbi, F. M., Zinchenko, I. A., Zucca, E., Allevato, V., Ballardini, M., Bolzonella, M., Bozzo, E., Burigana, C., Cabanac, R., Cappi, A., Di Ferdinando, D., Vigo, J. A. Escartin, Gabarra, L., Martín-Fleitas, J., Matthew, S., Mauri, N., Metcalf, R. B., Pezzotta, A., Pöntinen, M., Porciani, C., Risso, I., Scottez, V., Sereno, M., Tenti, M., Viel, M., Wiesmann, M., Akrami, Y., Andika, I. T., Anselmi, S., Archidiacono, M., Atrio-Barandela, F., Benoist, C., Benson, K., Bertacca, D., Bethermin, M., Bisigello, L., Blanchard, A., Blot, L., Brown, M. L., Bruton, S., Calabro, A., Quevedo, B. Camacho, Caro, F., Carvalho, C. S., Castro, T., Charles, Y., Cogato, F., Cooray, A. R., Cucciati, O., Davini, S., De Paolis, F., Desprez, G., Díaz-Sánchez, A., Diaz, J. J., Di Domizio, S., Diego, J. M., Duc, P. -A., Enia, A., Fang, Y., Ferrari, A. G., Ferreira, P. G., Finoguenov, A., Fontana, A., Franco, A., Ganga, K., García-Bellido, J., Gasparetto, T., Gautard, V., Gaztanaga, E., Giacomini, F., Gianotti, F., Gozaliasl, G., Guidi, M., Gutierrez, C. M., Hall, A., Hartley, W. G., Hemmati, S., Hernández-Monteagudo, C., Hildebrandt, H., Hjorth, J., Kajava, J. J. E., Kang, Y., Kansal, V., Karagiannis, D., Kiiveri, K., Kirkpatrick, C. C., Kruk, S., Graet, J. Le, Legrand, L., Lembo, M., Lepori, F., Leroy, G., Lesci, G. F., Lesgourgues, J., Leuzzi, L., Liaudat, T. I., Loureiro, A., Macias-Perez, J., Maggio, G., Magliocchetti, M., Magnier, E. A., Mannucci, F., Maoli, R., Martins, C. J. A. P., Maurin, L., Miluzio, M., Monaco, P., Moretti, C., Morgante, G., Murray, C., Naidoo, K., Navarro-Alsina, A., Nesseris, S., Passalacqua, F., Paterson, K., Patrizii, L., Pisani, A., Potter, D., Quai, S., Radovich, M., Sacquegna, S., Sahlén, M., Sanders, D. B., Sarpa, E., Schneider, A., Sciotti, D., Scognamiglio, D., Sellentin, E., Smith, L. C., Tanidis, K., Testera, G., Teyssier, R., Tosi, S., Troja, A., Tucci, M., Valieri, C., Venhola, A., Vergani, D., Verza, G., Vielzeuf, P., Walton, N. A., Sorce, J. G.
Institutions: Laboratoire d’Etudes du Rayonnement et de la Matière en Astrophysique et Atmosphères, Université Paris Diderot, Commissariat à l'Énergie Atomique et aux Énergies Alternatives, CEA Paris-Saclay - Etablissement de Saclay, Astrophysique, Instrumentation et Modélisation, CEA Paris-Saclay, Institut d'Astrophysique Spatiale, European Space Agency, Institut de Physique des 2 Infinis de Lyon, Centre de physique des particules de Marseille, Institut National de Physique Nucléaire et de Physique des Particules, Centre de Calcul de l’Institut National de Physique Nucléaire et de Physique des Particules, Laboratoire d’Astrophysique de Marseille, Institut d'Astrophysique de Paris, Centre Pierre Binétruy, University of California, Berkeley, Centre National d'Études Spatiales, Institut de Recherche en Astrophysique et Planétologie, Université de Lille, Laboratoire Univers et Théories, Observatoire astronomique de Strasbourg, CEA Cadarache, Institut de Recherche sur les Lois Fondamentales de l'Univers, Laboratoire de Physique Subatomique et de Cosmologie
Language: English
Subfield: Astronomy and Astrophysics
Field: Physics and Astronomy
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W4414903176