Hi,
The data has been migrated everywhere for a while now. We are stopping to write to the old columns (el_to, el_index, and el_index_60) and have already dropped it in several places.

If you don't update your tools and queries, it'll break in the next couple of weeks.

Best

Am Mi., 7. Juni 2023 um 16:38 Uhr schrieb Amir Sarabadani <asarabadani@wikimedia.org>:

Hello,

We have communicated this change in August 2022 but here is a reminder that if you query externallinks table in wikireplicas, you will need to rework your queries.


Changes are: el_to, el_index and el_index_60 fields will be dropped and you need to query el_to_domain_index and el_to_path fields instead.


The data has been migrated in all wikis except English Wikipedia, Wikimedia Commons and Wikidata, you can keep track of the data migration in T326314.


In late June, we will stop updating the old fields and will start dropping them 


This is done to optimize storage of external links (drastically reducing its size by removing duplication) and enabling user requested features such as resolving two fifteen-year-old tickets or easier aggregating of external links domain [1], something that wasn’t possible until now.


[1] For example, If you want to get list of the top-linked websites, you can query `SELECT el_to_domain_index, count(*) from externallinks group by el_to_domain_index order by count(*) desc limit 50;`


Thank you and sorry for the inconvenience.

--
Amir Sarabadani (he/him)
Staff Database Architect
Wikimedia Foundation