Knowledge Base

Appearance

Product-Live & LLM - A first real world use case with Fnac/Darty & OpenAI ​

To jump directly to the conclusions...

...click here

tldr

Introduction ​

At the beginning of May 2023, one of our major customers, Fnac/Darty, asked us to help them solve a problem they were encountering when migrating data between two of their systems. During this migration, one piece of data in particular posed a problem. The data in question - a product description - can be up to 10,000 characters long, but in the target system it cannot be longer than 3,500 characters.

The descriptions to be synthesized are very heterogeneous in their structure. Some include a large number of HTML tags that add nothing to the overall meaning of the description. Others have a lot of formatting (css), and some even have an extensive list of technical references (for example, in the case of a description of a spare part, it mentions the exhaustive list of devices with which this part is compatible, in some cases you can have up to several dozen references).

Sample description
html
<ul>.
<li><span style="font-size: 1px;"><b>lecteur cd portable blanc protection antidérapante, antichoc baladeur&nbsp; avec casque lcd</b></span><br></li>.
<li><br></li>.
<li><span style="font-size: 1px;">fonction principale-le lecteur de cd personnel offre toutes les fonctionnalités de lecture standard que vous attendez,y compris saut avant/arrière, lecture/pause, keylock, protection électronique de saut, anti-choc, 5 effets sonores, 4 modes de lecture, affichage led.</span></li>.
<li><span style="font-size: 1px;">portable et anti-choc-taille compacte de la paume, mesure 5.6 "x 5.6" x 1", adopte la technologie de protection anti-choc et électrique, protection anti-saut de 45 secondes pour les cd, protection anti-saut de 120 secondes pour les cd mp3, idéal pour jouer votre chanson préférée sur cd lors de vos déplacements en marchant.</span></li>.
<li><span style="font-size: 1px;">large compatibilité-compatible avec la plupart des formats tels que cd, cd-r, cd-rw, mp3 et wma fichiers audio à partir de cd, prise en charge de la connexion aux avec tous les autres appareils audibles via une entrée audio de 3.5mm.</span></li>.
<li><span style="font-size: 1px;">léger et portable:pesant moins de 260g (0,57lbs), petite taille (5.6 pouces)facilement dans votre sac, facile à emporter avec vous où que vous alliez, laissez la musique dans votre vie quotidienne.</span></li>.
<li><span style="font-size: 1px;">design à la mode et simple, léger et portable, facile à emporter partout où vous allez.</span></li>.
<li><span style="font-size: 1px;">cadeau parfait-le lecteur de cd personnel est un choix parfait comme cadeau, un cadeau pour les enfants, les bons amis, les aînés, etc. et un bon choix en tant que joueur en classe-jardin d'enfants/école primaire. apprentissage des langues, éducation prénatale, formation prénatale, lecture de musique cd/mp3. c'est le meilleur choix pour la formation prénatale, l'apprentissage des langues, etc. avec une taille de paume compacte, vous pouvez profiter de la musique à tout moment et n'importe où.</span></li>.
<li><br></li>.
<li><span style="font-size: 1px;"><b>caractéristiques:</b></span></li>.
<li><span style="font-size: 1px;">un excellent lecteur de cd avec une sortie audio de haute qualité, qui prend en charge différents formats, tels quecd, cd-rw, mp3, cd-da, wmapour que vous puissiez facilement profiter de la musique que vous voulez.</span></li>.
<li><span style="font-size: 1px;">connexion bluetooth, couplage automatique avec vos écouteurs bluetooth ou haut-parleur de musique, puis vous pouvez profiter de la musique via cet appareil.</span></li>.
<li><span style="font-size: 1px;">sortie audio stéréo hifi, prend en charge la plupart des effets musicaux tels que bbs, pop, jazz, classique, rock,etc. vous offre un excellent plaisir en musique.</span></li>.
<li><span style="font-size: 1px;">asp antichoc, cela vous aidera à profiter de la musique dans un état stable et à protéger vos oreilles.</span></li>.
<li><span style="font-size: 1px;">sortie aux 3.5mm et prise casque: vous pouvez connecter le lecteur à votre haut-parleur via la prise pour lire de la musique.</span></li>.
<li><br></li>.
<li><span style="font-size: 1px;"><b>spécifications:</b></span></li>.
<li><span style="font-size: 1px;">puissance: ca 110-220v</span></li>.
<li><span style="font-size: 1px;">sortie: 4.5v 600 mah</span></li>.
<li><span style="font-size: 1px;">puissance de sortie: 20mw (32ω double canal)</span></li>.
<li><span style="font-size: 1px;">batterie: 2 piles aa (non incluses)</span></li>.
<li><span style="font-size: 1px;">type de disque jouable: cd, cd-r, cd-rw</span></li>.
<li><span style="font-size: 1px;">prise en charge du format: cd, cd-rw, mp3, cd-da, wma</span></li>.
<li><span style="font-size: 1px;">affichage: écran led</span></li>.
<li><span style="font-size: 1px;">casque: 3.5mm</span></li>.
<li><span style="font-size: 1px;">effets sonores: normal, bbs, pop, jazz, rock, classique, etc.</span></li>.
<li><span style="font-size: 1px;">réponse en fréquence: 20hz</span></li>.
<li><span style="font-size: 1px;">rapport de bruit du signal: ≥ 80db</span></li>.
<li><br></li>.
<li><span style="font-size: 1px;"><b>ce que vous obtenez:</b></span></li>.
<li><span style="font-size: 1px;">1 xcd joueur</span></li>.
<li><span style="font-size: 1px;">1 xusb câble de charge</span></li>.
<li><span style="font-size: 1px;">1 x écouteur</span></li>.
<li><span style="font-size: 1px;">1 x manuel de l'utilisateur</span></li>.
</ul>

After analysis, we have identified two possible areas of work:

  • The first: attempt to reduce the size of the target description without altering the information (in particular by removing the css formatting). (I'm not going to detail this option here, as it was only able to effectively process 10% of the descriptions submitted.)
  • The second: Use LLM models to try to summarize without, as far as possible, altering the meaning of the text or introducing anomalies.)
  • A third interesting option would have been to use an algorithm dedicated to text summarization, but this avenue was not explored at the time of the POC.

Note: One option that was put on the table but quickly discarded was to simply truncate the description so that it respected the maximum size imposed by the target system.

Large Language Model (LLM) ​

Takeaway

LLMs are advanced language models, trained on a large amount of data that can be used for a variety of tasks, including text generation, classification, summarization, and translation.

LLMs, short for Large Language Model, is a type of machine learning model that can perform a variety of natural language processing (NLP) tasks, including generating and classifying text, answering questions in a conversational manner and translating text from one language to another.

LLMs are trained with immense amounts of data and use self-supervised learning to predict the next token in a sentence, given the surrounding context. The process is repeated over and over until the model reaches an acceptable level of accuracy.

Once an LLM has been trained, the possible applications are numerous:

  • Text generation: LLMs can be used to generate text for a variety of purposes, including bu_ilding a chatbot like ChatGPT
  • Text classification: LLMs can be used to classify text into categories
  • Text summarization: LLMs can be used to summarize text into a shorter version of the original text
  • Or even text translation

Popular examples of LLMs include GPT-3 (from the famous OpenAI), BERT (from Google) or RoBERTa (from Facebook).

Fnac/Darty ​

Fnac Darty is a French company specializing in the distribution of household appliances. Fnac/Darty and Product-Live it's:

  • A relationship that goes back more than 6 years
  • More than 200 active users
  • 100K+ Data Factory job execution in the last 12 months
  • 200K products handled by the platform

The start of a new adventure ​

Before we begin ​

We set ourselves the following objective: In a short time (no more than one day), to produce and evaluate descriptions synthesized by a given LLM model. (In parallel, we also tested approach number 1 described above, reducing the size of descirption by simply removing the text formatting. This document does not go into detail on this part of the POC)

We selected the gpt-3.5-turbo model from open AI (and in the time available, didn't take the time to test another). This model is described as follows by the OpenAI team:

GPT-3.5 models can understand and generate natural language or code. Our most capable and cost-effective model in the GPT-3.5 family is gpt-3.5-turbo which has been optimized for chat but works well for traditional completions tasks as well.

[gpt-3.5-turbo is the] most capable GPT-3.5 model and optimized for chat at 1/10th the cost of text-davinci-003. Will be updated with our latest model iteration.

The interaction with the model ​

The model (as any other LLM) works as follows:

  • We provide a prompt (a few words or sentences) to the model
  • The model then generates a text that is supposed to be a valid continuation of the prompt

In our tests, we tested the effectiveness of several prompts, and came up with the following results. It is structured as follows (and follows the best practices communicated by OpenAI):

  • Giving context to the model
  • Giving the model information on how to behave
  • Provide information to be taken into account (title and description of the product to be processed)
  • Give an instruction / ask a question
txt
Je m'occupe d'une équipe dont l'objectif est de proposer des fiches descriptives de produit les plus précises et compréhensibles possibles.

Je dispose d'un titre (assez court) et d'une description (assez longue) pour chaque produit.

Comportez-vous comme un membre de l'équipe, dont le rôle est de retraiter les descriptions de produits pour les rendre courtes et compréhensibles.

Vous pouvez utiliser le titre du produit pour vous aider à résumer la description. La description ne doit pas faire plus de ${size} caractères. Il est acceptable que certaines informations soient perdues dans le processus de résumé.

Vous pouvez éliminer les balises HTML, mais ne supprimez pas les liens ni les images.

Vous ne retournerez en résultat que la description que vous aurez retraitée. 

Voici le titre du produit: "${title}"

Voici la description du produit: 

${text}

The implementation ​

Interaction with the model is done in the classic way, via an API. Once you've created an account on the OpenAI platform, it's time to get started. The logic implemented for this POC is as follows:

mermaid
flowchart TD
    start["🏁 Start processing"]
    end_["🟢 End of processing"]
    open_and_read_excel_input("Open and read the Excel file containing the information to be processed")
    for_each_line("For each line of the Excel document")
    extract_data("Extract product 'title' and 'description' information")
    if_too_long("If the original description is too long... [1]")
    reduce_size("Delete as many sentences at the end of the description as necessary.")
    build_prompt("Promp building")
    ask_openai("Communicating the prompt to the OpenAI platform")
    get_and_evaluate_result("Retrieving and evaluating the results")
    if_result_ok("If the result is satisfactory [2]")
    add_result("Add result to excel file")
    dismiss_result("Result not added to excel file")
    end_for("End of the line processing")
    save_excel("Save Excel file")
    start --> open_and_read_excel_input
    open_and_read_excel_input --> for_each_line
    for_each_line --> extract_data
    extract_data --> if_too_long
    if_too_long -- "yes" --> reduce_size
    reduce_size --> build_prompt
    if_too_long -- "no" --> build_prompt
    build_prompt --> ask_openai
    ask_openai --> get_and_evaluate_result
    get_and_evaluate_result --> if_result_ok
    if_result_ok -- "yes" --> add_result
    if_result_ok --"No" --> dismiss_result
    dismiss_result --> end_for
    add_result --> end_for
    end_for -- "Handle next line" --> for_each_line
    end_for -- "No more line to handle" --> save_excel
    save_excel --> end_
  • [1] The gpt-3.5-turbo model is limited to 4,096 tokens when processing a prompt. This is a limitation of the model that will be lifted in the future versions of the model. (Since then, on 17/06/2023, OpenAI has announced the release of the gpt-3.5-turbo-16k model, offering a context of up to 16,000 tokens, 4 times more than previously available.)
  • [2] Here we were performing a very naive verification. If the model's answer looks like "Impossible to process your request", we simply ignore the proposed answer.

The first results ​

The first results are quite encouraging, after several hours of treatment for over 1000 descriptions. Following the processing described above, as well as a first quick pass over all the lines to judge their quality, 93% of the descriptions were successfully processed (the result produced is well below the 3500 characters mark as expected).

Here are a few before-and-after examples

Example 1

Before

html
<b>  <p>  <b></b>  </p> </b>  <p>  <p class="msonormal">   <span class="15" style="font-family:微软雅黑;color:#333333;font-weight:normal;font-style:normal;font-size:10.5000pt;"><strong>vendeur: etec-smart</strong></span>  </p> </p> <p>  description:<br /> <br /> bifteck, vin, gobelet, dîner romantique bien préparé: vous êtes souvent surpris par des bouchons de vin? vous pouvez allumer votre vin rouge en seulement six secondes en appuyant sur le bouton de ce produit.<br /> <br /> caractéristiques principales:<br /> <br /> ● faible bruit (moins de 60 db) pour un fonctionnement silencieux<br /> <br /> ● chargement rapide (5 minutes) pour une utilisation pratique<br /> <br /> ● la fonction d'affichage de l'alimentation vous permet de comprendre intuitivement la situation de l'alimentation<br /> <br /> ● convient pour de nombreuses occasions: maison, hôtel, fête, mariage, etc.<br /> <br /> ● le traitement de surface de la partie noire vous procure une sensation de toucher doux<br /> <br /> ● batterie li-ion 550mah intégrée<br /> <br /> poids du produit: 0,3650 kg<br /> <br /> poids de l'emballage: 0.5000 kg<br /> <br /> taille du produit (l xlxh): 22,00 x 4,80 x 4,80 cm / 8,66 x 1,89 x 1,89 pouces<br /> <br /> taille de l'emballage (l xlxh): 26,00 x 8,00 x 8,00 cm / 10,24 x 3,15 x 3,15 pouces<br /> <br /> contenu de l'emballage: 1 x ouvre-bouteille, 1 x câble usb, 1 x chargeur de papier, 1 x manuel chinois </p> <div class="self-adaption">  <img alt="20181229200402_47090.jpg" src="http://pdmimg.ovonni.com/uploads/pdm-desc-pic/electronic/image/2018/12/29/20181229200402_47090.jpg" title="20181229200402_47090.jpg" style="width:580px;" /><br /> </div> <div class="self-adaption">  <img alt="20181229200402_79012.jpg" src="http://pdmimg.ovonni.com/uploads/pdm-desc-pic/electronic/image/2018/12/29/20181229200402_79012.jpg" title="20181229200402_79012.jpg" style="width:580px;" />  </div> <div class="self-adaption">  <img alt="20181229200403_65934.jpg" src="http://pdmimg.ovonni.com/uploads/pdm-desc-pic/electronic/image/2018/12/29/20181229200403_65934.jpg" title="20181229200403_65934.jpg" style="width:580px;" />  </div> <div class="self-adaption">  <img alt="20181229200403_94229.jpg" src="http://pdmimg.ovonni.com/uploads/pdm-desc-pic/electronic/image/2018/12/29/20181229200403_94229.jpg" title="20181229200403_94229.jpg" style="width:580px;" />  </div> <div class="self-adaption">  <img alt="20181229200404_47720.jpg" src="http://pdmimg.ovonni.com/uploads/pdm-desc-pic/electronic/image/2018/12/29/20181229200404_47720.jpg" title="20181229200404_47720.jpg" style="width:580px;" />  </div> <div class="self-adaption">  <img alt="20181229200404_20029.jpg" src="http://pdmimg.ovonni.com/uploads/pdm-desc-pic/electronic/image/2018/12/29/20181229200404_20029.jpg" title="20181229200404_20029.jpg" style="width:580px;" />  </div> <div class="self-adaption">  <img alt="20181229200404_47232.jpg" src="http://pdmimg.ovonni.com/uploads/pdm-desc-pic/electronic/image/2018/12/29/20181229200404_47232.jpg" title="20181229200404_47232.jpg" style="width:580px;" />  </div> <div class="self-adaption">  <img alt="20181229200404_21443.jpg" src="http://pdmimg.ovonni.com/uploads/pdm-desc-pic/electronic/image/2018/12/29/20181229200404_21443.jpg" title="20181229200404_21443.jpg" style="width:580px;" />  </div> <div class="self-adaption">  <img alt="20181229200404_30191.jpg" src="http://pdmimg.ovonni.com/uploads/pdm-desc-pic/electronic/image/2018/12/29/20181229200404_30191.jpg" title="20181229200404_30191.jpg" style="width:580px;" />  </div> <div class="self-adaption">  <img alt="20181229200404_58871.jpg" src="http://pdmimg.ovonni.com/uploads/pdm-desc-pic/electronic/image/2018/12/29/20181229200404_58871.jpg" title="20181229200404_58871.jpg" style="width:580px;" />  </div> <div class="self-adaption">  <img alt="20181229200405_40059.jpg" src="http://pdmimg.ovonni.com/uploads/pdm-desc-pic/electronic/image/2018/12/29/20181229200405_40059.jpg" title="20181229200405_40059.jpg" style="width:580px;" />  </div> <br /> <br /> <br />

After

html
Le tire-bouchon électrique noir Xiaomi Mijia permet d'ouvrir les bouteilles de vin rouge en seulement six secondes, avec
une faible émission de bruit (<60dB) et une charge rapide (5 minutes). La fonction d'affichage de l'alimentation permet
de connaître facilement l'état de la batterie li-ion intégrée (550mAh). Peu encombrant et facile à transporter, il
convient pour diverses occasions telles que la maison, l'hôtel, la fête ou le mariage. Le traitement de surface de la
partie noire lui procure une sensation de toucher doux. Ce produit est livré avec un câble USB, un chargeur de papier et
un manuel chinois.
Example 2

Before

html
Portable mini projecteur intelligent supporte 4k 1080p uhd hdmi usb tf carte
pour home cinéma / tv / ordinateur portable pour iphone andriod smartphone
<br />
fonctionnalité: <br />
projecteur: csq a mis à niveau notre projecteur pico à 1500 lumens avec un
rapport de contraste de 2000: 1, 50 % plus lumineux et plus net que les
mini-projecteurs pico led comparables sur le marché.le projecteur dlp full hd de
haute qualité avec affichage haute résolution accepte les sources vidéo 4k full
hd 1080p et adapte automatiquement le contenu à la résolution wvga. <br />
multi-fuction: système android 6.0 et le module wi-fi, vous pouvez naviguer
directement sur le web sur chrome, diffuser des vidéos en ligne sur youtube sans
aucun appareil externe. jeux en streaming à partir d'ios / android sans fil,
partage de photos / vidéos avec votre famille sans fil avec grand écran!
consoles de jeu prises en charge: ps2, ps3, xbox etc. prise en charge de hotpost
avec contrôle d'écran tactile, parfait pour le divertissement. <br />
ram 2 go ddr3 & hdmi entrée: avec une mémoire de 2 go / 16 go, le projecteur
vidéo wifi cangsiki possède une entrée hdmi. vous pouvez donc connecter le
projecteur à votre ordinateur portable / pc directement par le câble hdmi (vous
pouvez également vous connecter avec eux par wi-fi sans fil ou
bluetooth). maintenant, vous pouvez jouer à des jeux vidéo en haute définition
de très haute qualité sur n'importe quel mur de votre maison.entrée usb 2.0 et
emplacement pour carte microsd / tf prenant en charge 32 go. connexion de
haut-parleur 3,5 mm et sans fil. <br />
design portable: projecteur de cinéma maison à batterie rechargeable intégrée de
5000 mah avec un design portable (l * w * h: 5,7 * 3,1 * 0,7 pouce), adapté pour
le camping de voyage, la fête en plein air, nice des cadeaux pour les enfants,
les amis et les amoureux. le format d'image 16: 9 et la résolution standard de
définition vous permettent de projeter des divertissements et des présentations
sur grand écran jusqu'à 120 pouces. <br />
spécifications: <br />
moteur d'éclairage: dlp 0,3 pouce dmd + rgb led et ram: 2g ddr3 + rom mémoire
flash 16gb <br />
résolution: 854x480 (wvga) <br />
résolution d'entrée: jusqu'à 4k (prise en charge uniquement en cas de connexion
avec d'autres joueurs via hdmi) cpu: amlogic s905, 4xarm cortex a53 2.0ghz
<br />
rapport de contraste: 2000: 1 taille de projection: 30-120 pouces <br />
bluetooth: bt4.0 lnputs: usb, ir, haut-parleur <br />
wi-fi intégré: 802.11 a / b / g / n / ac (2,4 / 5,0 ghz) <br />
haut-parleur intégré: 1 watt (recommander de connecter un haut-parleur
bluetooth) <br />
décodage vidéo: prise en charge 4k * 2k 10 bits hevc / h.265 <br />
formats vidéo : rm / rmvb / avi / mkv / wmv / mp4 / vob <br />
formats audio: mp3 / ac3-dts / ogg / ape / flac / aac / wav / wma <br />
miroir d'écran: fonction eshare / airplay / miracast <br />
rapport de projection: 1,4: 1 <br />
rapport d'aspect: 4: 3/16: 9 / 16:10 <br />
durée de vie de la lampe: 20000 heures <br />
correction trapézoïdale: automatique, verticale: ± 40 degrés <br />
carte micro sd / tf: supporte jusqu'à 32 go de capacité (non incluse) <br />
autonomie de la batterie: 2- 2,5 heures <br />
botton: touche tactile <br />
alimentation: 5v-3a <br />
dimension (lxlxh): 5,7 x 3,1 x 0,7 pouces (14,5 x 8 x 1,8 cm) <br />
poids: environ 7,4 oz / 210 g <br />
couleur: noir <br />
entrée vidéo: <br />
1xhdmi (entrée hd) 1xdc (dc 5v / 3a) 2xusb (prise en charge du disque flash usb,
du disque dur mobile, etc.) <br />
1xmicro sd / tf card (non inclus) <br />
sortie audio: <br />
prise d'écouteur audio 1x3.5mm (peut répondre au casque ou au haut-parleur)
<br />
1xbluetooth4.0 (prise en charge de l'envoi de photos et de vidéos via un
téléphone intelligent) <br />
contenu de l'emballage: <br />
1x mini projecteur <br />
1x télécommande sans fil 2.4g <br />
1x câble hdmi <br />
1x support de trépied extensible <br />
chargeur 1xdc <br />
câble 1xusb <br />
1x manuel d'utilisation <br />. Utilisation vidéoprojecteur : home cinéma. Type
connecteur entrée vidéo : hdmi. Système de projection : dlp

After

html
Ce mini vidéoprojecteur intelligent supporte 4k 1080p UHD HDMI USB TF carte pour la maison. Avec un rapport de contraste de 2000:1, 1500 lumens et une résolution WVGA, il s'adapte automatiquement au contenu. Vous pouvez naviguer directement sur le web sur chrome grâce au système Android 6.0 et au module Wi-Fi. Il possède une entrée HDMI et USB et un emplacement pour carte microSD/TF pouvant atteindre 32 go. Il est portable et design avec une batterie rechargeable intégrée de 5000 mAh. Le format 16:9 et la résolution standard de définition vous permettent de projeter des divertissements et présentations sur grand écran jusqu'à 120 pouces. Le contenu de l'emballage comprend le mini projecteur, une télécommande sans fil 2.4g, un câble HDMI, un support de trépied extensible, un chargeur DC, un câble USB et un manuel d'utilisation. Utilisation pour home cinéma avec type connecteur d'entrée vidéo HDMI et système de projection DLP.
Example 3
html
<div class="class_perso1">pompe de vidange lave-linge ( adaptable )</div>
<div class="class_perso2">montage sur bosch, siemens</div>
<div class="class_perso3">
 code produit : 00144192 00144484 00144305 00145787
</div>
<div class="class_perso4">appareils employant cette pièce :</div>
<div class="class_perso5">
 cwf06a10il/01<br />cwf06a10il/04<br />cwf06a11il/01<br />cwf06a11il/04<br />cwf06a11il/05<br />cwf06a11il/07<br />cwf06a11il/09<br />cwf06a11il/11<br />cwf06a11il/15<br />cwf06a11il/24<br />cwf06a11il/26<br />cwf06a12il/01<br />cwf06a12il/02<br />cwf06a12il/05<br />cwf06a12il/08<br />cwf06a12il/09<br />cwf08a10il/01<br />cwf08a10il/04<br />cwf08a11il/01<br />cwf08a11il/04<br />cwf08a11il/05<br />cwf08a11il/09<br />cwf08a11il/11<br />cwf08a11il/16<br />cwf08a11il/17<br />cwf08a11il/21<br />cwf08a11il/24<br />cwf08a11il/26<br />cwf08a12il/01<br />cwf08a12il/02<br />cwf08a12il/05<br />cwf08a12il/08<br />cwf08a12il/09<br />cwf08b00il/01<br />cwf08b00il/05<br />cwf08b00il/07<br />cwf08b00il/08<br />cwf08b00il/20<br />cwf08b00il/21<br />cwf08b00il/23<br />cwf08b00il/24<br />cwf08b00il/25<br />cwf08b00il/27<br />cwf08b20il/01<br />cwf08b20il/20<br />cwf08b20il/21<br />cwf08e060i/01<br />cwf08e060i/08<br />cwf10a10/01<br />cwf10a10/04<br />cwf10a10fg/01<br />cwf10a11/01<br />cwf10a11/04<br />cwf10a11/05<br />cwf10a11/09<br />cwf10a11/11<br />cwf10a11/16<br />cwf10a12/11<br />cwf10a12/13<br />cwf10a12/16<br />cwf10a12/24<br />cwf10a12/26<br />cwf10a12/32<br />cwf10a12/33<br />cwf10a13il/01<br />cwf10a13il/02<br />cwf10a13il/05<br />cwf10a13il/08<br />cwf10a13il/09<br />cwf10a20/01<br />cwf10a20/05<br />cwf10a20/08<br />cwf10a20/10<br />cwf10b10/01<br />cwf10b10/03<br />cwf10b10/04<br />cwf10b10/05<br />cwf10b10/09<br />cwf10b20il/01<br />cwf10b20il/03<br />cwf10b20il/10<br />cwf10b21il/01<br />cwf10b21il/15<br />cwf10b21il/16<br />cwf10b21il/17<br />cwf10b21il/20<br />cwf10b21il/21<br />cwf10b21il/22<br />cwf10b21il/23<br />cwf10e060i/01<br />cwf10e060i/08<br />cwf11b11/01<br />cwf11b11/18<br />cwf11b12/01<br />cwf11b12/20<br />cwf11b12/21<br />cwf11b12/23<br />cwf11b12/24<br />cwf11b12/27<br />cwf12a10/01<br />cwf12a10/04<br />cwf12a10be/01<br />cwf12a10be/04<br />cwf12a10be/05<br />cwf12a10be/09<br />cwf12a10be/11<br />cwf12a10be/12<br />cwf12a10be/20<br />cwf12a10be/24<br />cwf12a10be/27<br />cwf12a10be/32<br />cwf12a10be/33<br />cwf12a10fg/01<br />cwf12a10fg/04<br />cwf12a11/01<br />cwf12a11/04<br />cwf12a11/05<br />cwf12a11/09<br />cwf12a11/11<br />cwf12a12/11<br />cwf12a12/13<br />cwf12a12/20<br />cwf12a12/24<br />cwf12a12/27<br />cwf12a12/32<br />cwf12a12/33<br />cwf12b00nl/01<br />cwf12b00nl/02<br />cwf12b00nl/03<br />cwf12b00nl/04<br />cwf12b00nl/05<br />cwf12b10/01<br />cwf12b10/02<br />cwf12b10/03<br />cwf12b10/04<br />cwf12b10/05<br />cwf12b10/09<br />cwf13b11/01<br />cwf13b11/16<br />cwf13b12/01<br />cwf13b12/22<br />cwf13b12/23<br />cwf13b12/24<br />cwf13b12/27<br />cwf14a10/01<br />cwf14a10/04<br />cwf14a10/09<br />cwf14a10be/01<br />cwf14a10be/04<br />cwf14a10be/05<br />cwf14a10be/07<br />cwf14a10be/09<br />cwf14a10be/11<br />cwf14a10be/15<br />cwf14a10be/24<br />cwf14a10be/27<br />cwf14a10be/29<br />cwf14a10be/32<br />cwf14a10be/33<br />cwf14a10fg/01<br />cwf14a10fg/04<br />cwf14a10fg/09<br />cwf14a11/01<br />cwf14a11/04<br />cwf14a11/05<br />cwf14a11/07<br />cwf14a11/09<br />cwf14a11/11<br />cwf14a12/11<br />cwf14a12/13<br />cwf14a12/24<br />cwf14a12/27<br />cwf14a12/29<br />cwf14a12/32<br />cwf14a12/33<br />cwf14a20/01<br />cwf14a20/08<br />cwf14a20/09<br />cwf14a20/10<br />cwf14a22/13<br />cwf14a22/24<br />cwf14a22/27<br />cwf14a22/29<br />cwf14a22/32<br />cwf14a22/33<br />cwf14b00nl/01<br />cwf14b00nl/02<br />cwf14b00nl/03<br />cwf14b00nl/04<br />cwf14b00nl/05<br />cwf14b00nl/16<br />cwf14b10/01<br />cwf14b10/02<br />cwf14b10/03<br />cwf14b10/04<br />cwf14b10/05<br />cwf14b10/09<br />cwf14b10/16<br />cwf14b20/01<br />cwf14b20/02<br />cwf14b20/03<br />cwf14b20/04<br />cwf14b20/07<br />cwf14b20/11<br />cwf14b21/01<br />cwf14b21/17<br />cwf14b21/20<br />cwf14b21/21<br />cwf14b21/22<br />cwf14b21/23<br />cwf14b21nl/01<br />cwf14b21nl/17<br />cwf14b21nl/20<br />cwf14b21nl/21<br />cwf14b21nl/22<br />cwf14b21nl/23<br />vvw08a00it/01<br />vvw08a00it/04<br />vvw10a00gb/01<br />vvw10a00gb/04<br />vvw10a00it/01<br />vvw10a00it/04<br />vvw11a00ff/01<br />vvw11a00ff/04<br />vvw11a00ff/08<br />vvw11a00ff/10<br />vvw11a00fr/01<br />vvw11a00fr/04<br />vvw11a00fr/05<br />vvw12a00gb/01<br />vvw12a00gb/04<br />waa12160by/01<br />waa12160by/04<br />waa12160ii/01<br />waa12160ii/04<br />waa12160ii/05<br />waa12160ii/07<br />waa12160ii/09<br />waa12160ii/11<br />waa12160it/01<br />waa12160it/04<br />waa12160me/01<br />waa12160me/04<br />waa12160me/08<br />waa12160me/10<br />waa12160tr/01<br />waa12160tr/03<br />waa12160tr/04<br />waa12160tr/05<br />waa12160tr/07<br />waa12160tr/09<br />waa12160tr/11<br />waa12161bc/11<br />waa12161bc/24<br />waa12161by/01<br />waa12161by/04<br />waa12161by/05<br />waa12161by/07<br />waa12161by/09<br />waa12161by/11<br />waa12161ii/09<br />waa12161ii/11<br />waa12161ii/18<br />waa12161ii/24<br />waa12161ii/25<br />waa12161ii/32<br />waa12161tr/11<br />waa12161tr/18<br />waa12161tr/24<br />waa12161tr/32<br />waa12161tr/33<br />waa12162by/01<br />waa12162by/09<br />waa12162by/11<br />waa12162by/13<br />waa12162by/18<br />waa12162by/24<br />waa12162ii/25<br />waa12162ii/32<br />waa12162ii/33<br />waa12163by/01<br />waa12163by/05<br />waa12163by/08<br />waa12163by/09<br />waa12165me/01<br />waa12165me/02<br />waa12165me/04<br />waa12165me/05<br />waa12165me/07<br />waa12165me/08<br />waa12165me/09<br />waa12165me/11<br />waa12165me/12<br />waa12165me/24<br />waa12165sg/01<br />waa12165sg/04<br />waa12165sg/07<br />waa12165sg/08<br />waa12165sg/09<br />waa12165sg/11<br />waa12165sg/15<br />waa12165sg/24<br />waa12166sg/01<br />waa12166sg/05<br />waa12166sg/08<br />waa12166sg/09<br />waa14160pl/01<br />waa14160pl/04<br />waa16110ee/01<br />waa16110ee/04<br />waa16110ee/08<br />waa16110ee/10<br />waa16110tr/01<br />waa16110tr/03<br />waa16110tr/04<br />waa16110tr/05<br />waa16110tr/09<br />waa16110tr/11<br />waa16110tr/16<br />waa16111tr/11<br />waa16111tr/16<br />waa16111tr/21<br />waa16111tr/24<br />waa16111tr/32<br />waa16111tr/33<br />waa16160by/01<br />waa16160by/04<br />waa16160ii/01<br />waa16160ii/04<br />waa16160ii/05<br />waa16160ii/09<br />waa16160ii/11<br />waa16160ii/16<br />waa16160it/01<br />waa16160it/04<br />waa16160me/01<br />waa16160me/04<br />waa16160oe/01<br />waa16160oe/04<br />waa16160pl/01<br />waa16160pl/04<br />waa16160tr/01<br />waa16160tr/03<br />waa16160tr/04<br />waa16160tr/05<br />waa16160tr/09<br />waa16160tr/11<br />waa16160tr/16<br />waa16161bc/11<br />waa16161bc/16<br />waa16161bc/21<br />waa16161bc/24<br />waa16161bc/32<br />waa16161bc/33<br />waa16161by/01<br />waa16161by/04<br />waa16161by/05<br />waa16161by/09<br />waa16161by/11<br />waa16161by/16<br />waa16161ii/09<br />waa16161ii/11<br />waa16161ii/16<br />waa16161ii/21<br />waa16161ii/24<br />waa16161ii/25<br />waa16161oe/01<br />waa16161oe/04<br />waa16161oe/05<br />waa16161oe/09<br />waa16161oe/11<br />waa16161oe/16<br />waa16161pl/01<br />waa16161pl/04<br />waa16161pl/05<br />waa16161pl/09<br />waa16161pl/11<br />waa16161pl/16<br />waa16161pl/17<br />waa16161pl/18<br />waa16161pl/21<br />waa16161pl/24<br />waa16161tr/11<br />waa16161tr/16<br />waa16161tr/21<br />waa16161tr/24<br />waa16161tr/32<br />waa16161tr/33<br />waa16162by/01<br />waa16162by/09<br />waa16162by/11<br />waa16162by/13<br />waa16162by/16<br />waa16162by/18<br />waa16162by/21<br />waa16162by/24<br />waa16162ii/25<br />waa16162ii/32<br />waa16162oe/11<br />waa16162oe/16<br />waa16162oe/21<br />waa16163by/01<br />waa16163by/05<br />waa16163by/08<br />waa16163by/09<br />waa16163ii/25<br />waa16163ii/32<br />waa16163ii/33<br />waa16163pl/01<br />waa16163pl/05<br />waa16163pl/08<br />waa16163pl/09<br />waa16165me/01<br />waa16165me/04<br />waa16165me/05<br />waa16165me/09<br />waa16165me/11<br />waa16165me/12<br />waa16165me/16<br />waa16165me/21<br />waa16165me/24<br />waa16166me/01<br />waa16166me/05<br />waa16166me/07<br />waa16166me/08<br />waa16166me/09<br />waa16170ce/01<br />waa16170ce/04<br />waa16170ce/05<br />waa16170ce/09<br />waa16170ce/11<br />waa16170ce/16<br />waa16170ce/17<br />waa16170ce/21<br />waa16170ce/24<br />waa16171ce/24<br />waa16171ce/32<br />waa16171ce/33<br />waa16260it/01<br />waa16260it/05<br />waa16260it/08<br />waa16260it/10<br />waa16260oe/01<br />waa16260oe/05<br />waa16260oe/08<br />waa16260oe/10<br />waa16260pl/01<br />waa16260pl/04<br />waa16260pl/05<br />waa16260pl/08<br />waa16261oe/01<br />waa16261oe/09<br />waa16261oe/11<br />waa16261oe/13<br />waa16261oe/14<br />waa16261oe/16<br />waa16261oe/21<br />waa18160by/01<br />waa18160by/04<br />waa20110ar/01<br />waa20110ar/09<br />waa20110ar/16<br />waa20110ar/17<br />waa20110ar/24<br />waa20110ar/31<br />waa20110ee/01<br />waa20110ee/04<br />waa20110ee/08<br />waa20110ee/10<br />waa20112ee/11<br />waa20112ee/16<br />waa20112ee/24<br />waa20113ee/24<br />waa20113ee/32<br />waa20113ee/33<br />waa2011gtr/01<br />waa2011gtr/03<br />waa2011gtr/04<br />waa2011gtr/05<br />waa2011gtr/09<br />waa2011gtr/11<br />waa2011gtr/16<br />waa2011str/11<br />waa2011str/16<br />waa2011str/24<br />waa2011str/32<br />waa2011str/33<br />waa20160/01<br />waa20160/04<br />waa20160by/01<br />waa20160by/04<br />waa20160gb/01<br />waa20160gb/04<br />waa20160ii/01<br />waa20160ii/04<br />waa20160ii/05<br />waa20160ii/09<br />waa20160ii/11<br />waa20160ii/16<br />waa20160it/01<br />waa20160it/04<br />waa20160me/01<br />waa20160me/04<br />waa20160me/08<br />waa20160me/10<br />waa20160oe/01<br />waa20160oe/04<br />waa20160sn/01<br />waa20160sn/02<br />waa20160sn/03<br />waa20160sn/04<br />waa20160sn/08<br />waa20160sn/10<br />waa20160tr/01<br />waa20160tr/03<br />waa20160tr/04<br />waa20160tr/05<br />waa20160tr/09<br />waa20160tr/11<br />waa20160tr/16<br />waa20161by/01<br />waa20161by/04<br />waa20161by/05<br />waa20161by/09<br />waa20161by/11<br />waa20161by/16<br />waa20161ii/09<br />waa20161ii/11<br />waa20161ii/16<br />waa20161ii/24<br />waa20161ii/25<br />waa20161oe/01<br />waa20161oe/04<br />waa20161oe/05<br />waa20161oe/09<br />waa20161oe/11<br />waa20161oe/16<br />waa20161pl/01<br />waa20161pl/04<br />waa20161pl/05<br />waa20161pl/09<br />waa20161pl/11<br />waa20161pl/16<br />waa20161sn/01<br />waa20161sn/06<br />waa20161sn/09<br />waa20161sn/11<br />waa20161sn/12<br />waa20161sn/13<br />waa20161sn/16<br />waa20161tr/11<br />waa20161tr/16<br />waa20161tr/24<br />waa20161tr/32<br />waa20161tr/33<br />waa20162by/01<br />waa20162by/09<br />waa20162by/11<br />waa20162by/13<br />waa20162by/16<br />waa20162by/18<br />waa20162by/24<br />waa20162ii/25<br />waa20162ii/32<br />waa20162ii/33<br />waa20162oe/01<br />waa20162oe/09<br />waa20162oe/11<br />waa20162oe/16<br />waa20162pl/11<br />waa20162pl/16<br />waa20162pl/18<br />waa20162pl/24<br />waa20162sn/13<br />waa20162sn/24<br />waa20163ii/25<br />waa20163ii/32<br />waa20163ii/33<br />waa20163pl/01<br />waa20163pl/05<br />waa20163pl/08<br />waa20163pl/09<br />waa20163sn/01<br />waa20163sn/05<br />waa20163sn/08<br />waa20163sn/09<br />waa20165gc/05<br />waa20165gc/08<br />waa20165gc/09<br />waa20165me/01<br />waa20165me/04<br />waa20165me/05<br />waa20165me/09<br />waa20165me/11<br />waa20165me/12<br />waa20165me/16<br />waa20165me/24<br />waa20166me/11<br />waa20166me/16<br />waa20166me/24<br />waa20167me/01<br />waa20167me/05<br />waa20167me/08<br />waa20167me/09<br />waa2016kby/01<br />waa2016kby/05<br />waa2016kby/08<br />waa2016kby/09<br />waa2016sbc/11<br />waa2016sbc/16<br />waa2016sbc/18<br />waa2016sbc/24<br />waa20170ce/01<br />waa20170ce/04<br />waa20170ce/05<br />waa20170ce/09<br />waa20170ce/11<br />waa20170ce/16<br />waa20170ce/17<br />waa20170ce/18<br />waa20170ce/24<br />waa20170ff/01<br />waa20170ff/04<br />waa20170ff/08<br />waa20170ff/10<br />waa20171ce/24<br />waa20171ce/32<br />waa20171ce/33<br />waa20181ce/11<br />waa20181ce/13<br />waa20181ce/24<br />waa20182ce/24<br />waa20182ce/32<br />waa20182ce/33<br />waa20260/01<br />waa20260/04<br />waa20260/05<br />waa20260/08<br />waa20260/10<br />waa20260by/01<br />waa20260by/05<br />waa20260by/08<br />waa20260by/10<br />waa20260ee/01<br />waa20260ee/05<br />waa20260ee/08<br />waa20260ee/10<br />waa20260oe/01<br />waa20260oe/05<br />waa20260oe/08<br />waa20260oe/10<br />waa20260pl/01<br />waa20260pl/04<br />waa20260pl/05<br />waa20260pl/08<br />waa20260pl/10<br />waa20261by/01<br />waa20261by/09<br />waa20261by/11<br />waa20261by/13<br />waa20261by/14<br />waa20261by/16<br />waa20261by/24<br />waa20261oe/01<br />waa20261oe/09<br />waa20261oe/11<br />waa20261oe/13<br />waa20261oe/14<br />waa20261oe/16<br />waa20261oe/18<br />waa20261oe/24<br />waa20261pl/01<br />waa20261pl/09<br />waa20261pl/11<br />waa20261pl/13<br />waa20261pl/14<br />waa20261pl/16<br />waa20261pl/24<br />waa20262by/01<br />waa20262by/08<br />waa20262by/09<br />waa20262pl/01<br />waa20262pl/08<br />waa20262pl/09<br />waa2026fpl/24<br />waa2026fpl/32<br />waa2026fpl/33<br />waa2026jpl/01<br />waa2026jpl/08<br />waa2026jpl/10<br />waa2026kpl/01<br />waa2026kpl/08<br />waa2026kpl/09<br />waa2026sby/01<br />waa2026sby/05<br />waa2026sby/08<br />waa2026sby/10<br />waa20270ce/01<br />waa20270ce/08<br />waa20270ce/10<br />waa20271ce/14<br />waa20271ce/16<br />waa20271ce/18<br />waa20271ce/24<br />waa20272ce/01<br />waa20272ce/08<br />waa20272ce/09<br />waa2027jpl/01<br />waa2027jpl/09<br />waa2027jpl/11<br />waa2027jpl/13<br />waa2027jpl/14<br />waa2027jpl/16<br />waa2027jpl/24<br />waa2027sby/01<br />waa2027sby/09<br />waa2027sby/11<br />waa2027sby/13<br />waa2027sby/14<br />waa2027sby/16<br />waa2027sby/18<br />waa2027sby/24<br />waa2028jpl/01<br />waa2028jpl/08<br />waa2028jpl/09<br />waa2028sby/01<br />waa2028sby/08<br />waa2028sby/09<br />waa22170ff/01<br />waa22170ff/04<br />waa22170ff/08<br />waa22170ff/10<br />waa24120/01<br />waa24120/04<br />waa24120/05<br />waa24120be/01<br />waa24120be/04<br />waa24120be/05<br />waa24120be/09<br />waa24120be/11<br />waa24120be/12<br />waa24120fg/01<br />waa24120fg/04<br />waa24160/01<br />waa24160/04<br />waa24160by/01<br />waa24160by/04<br />waa24160fg/01<br />waa24160fg/04<br />waa24160fn/01<br />waa24160fn/04<br />waa24160fn/05<br />waa24160fn/09<br />waa24160fn/11<br />waa24160gb/01<br />waa24160gb/04<br />waa24160nl/01<br />waa24160nl/04<br />waa24160oe/01<br />waa24160oe/04<br />waa24160sn/01<br />waa24160sn/02<br />waa24160sn/03<br />waa24160sn/04<br />waa24160sn/08<br />waa24160sn/10<br />waa24161/01<br />waa24161/04<br />waa24161/05<br />waa24161/09<br />waa24161/11<br />waa24161by/01<br />waa24161by/04<br />waa24161by/05<br />waa24161by/09<br />waa24161by/11<br />waa24161fn/11<br />waa24161fn/13<br />waa24161fn/20<br />waa24161fn/24<br />waa24161fn/32<br />waa24161fn/33<br />waa24161gb/01<br />waa24161gb/04<br />waa24161gb/05<br />waa24161gb/08<br />waa24161gb/10<br />waa24161pl/01<br />waa24161pl/04<br />waa24161pl/05<br />waa24161pl/09<br />waa24161pl/11<br />waa24161sn/01<br />waa24161sn/06<br />waa24161sn/09<br />waa24161sn/11<br />waa24161sn/12<br />waa24161sn/13<br />waa24162/01<br />waa24162/09<br />waa24162/11<br />waa24162/13<br />waa24162/20<br />waa24162/24<br />waa24162/32<br />waa24162/33<br />waa24162by/01<br />waa24162by/09<br />waa24162by/11<br />waa24162by/13<br />waa24162by/20<br />waa24162by/24<br />waa24162gb/11<br />waa24162gb/20<br />waa24162pl/11<br />waa24162pl/20<br />waa24162pl/24<br />waa24162sn/13<br />waa24162sn/20<br />waa24162sn/24<br />waa24163by/01<br />waa24163by/05<br />waa24163by/08<br />waa24163by/09<br />waa24163pl/01<br />waa24163pl/05<br />waa24163pl/08<br />waa24163pl/09<br />waa24163sn/01<br />waa24163sn/05<br />waa24163sn/08<br />waa24163sn/09<br />waa24165nn/01<br />waa24165nn/02<br />waa24165nn/03<br />waa24165nn/04<br />waa24165nn/08<br />waa24165nn/10<br />waa24166gb/24<br />waa24167gb/24<br />waa24167gb/32<br />waa24167gb/33<br />waa24169gb/01<br />waa24169gb/09<br />waa24169gb/11<br />waa24169gb/19<br />waa24169gb/20<br />waa24169gb/24<br />waa24169gb/32<br />waa2416kpl/01<br />waa2416kpl/09<br />waa2416kpl/11<br />waa2416kpl/17<br />waa2416kpl/20<br />waa2416kpl/24<br />waa24170ff/01<br />waa24170ff/04<br />waa24170ff/08<br />waa24170ff/10<br />waa24170nl/01<br />waa24170nl/04<br />waa24170sn/01<br />waa24170sn/02<br />waa24170sn/03<br />waa24170sn/04<br />waa2417kpl/01<br />waa2417kpl/05<br />waa2417kpl/08<br />waa2417kpl/09<br />waa24180nl/01<br />waa24180nl/04<br />waa24222/01<br />waa24222/09<br />waa24222/11<br />waa24222/13<br />waa24222/14<br />waa24222/20<br />waa24222/24<br />waa24222/32<br />waa24222/33<br />waa24260/01<br />waa24260/04<br />waa24260/05<br />waa24260/08<br />waa24260/10<br />waa24260by/01<br />waa24260by/05<br />waa24260by/08<br />waa24260by/10<br />waa24260ee/01<br />waa24260ee/05<br />waa24260ee/08<br />waa24260ee/10<br />waa24260ff/01<br />waa24260ff/04<br />waa24260ff/05<br />waa24260ff/08<br />waa24260ff/10<br />waa24260fg/01<br />waa24260fg/04<br />waa24260fg/05<br />waa24260fg/08<br />waa24260fg/10<br />waa24260nl/01<br />waa24260oe/01<br />waa24260oe/05<br />waa24260oe/08<br />waa24260oe/10<br />waa24260pl/01<br />waa24260pl/08<br />waa24260pl/10<br />waa24260sk/01<br />waa24260sk/04<br />waa24260sk/05<br />waa24260sk/08<br />waa24260sk/10<br />waa24261/01<br />waa24261/05<br />waa24261/08<br />waa24261/10<br />waa24261by/01<br />waa24261by/09<br />waa24261by/11<br />waa24261by/13<br />waa24261by/14<br />waa24261by/20<br />waa24261by/24<br />waa24261ii/11<br />waa24261ii/20<br />waa24261ii/24<br />waa24261nl/14<br />waa24261nl/20<br />waa24261nl/24<br />waa24261pl/11<br />waa24261pl/13<br />waa24261pl/14<br />waa24261pl/20<br />waa24261pl/24<br />waa24262pl/01<br />waa24262pl/08<br />waa24262pl/09<br />waa2426kby/01<br />waa2426kby/08<br />waa2426kby/09<br />waa24271ce/14<br />waa24271ce/20<br />waa24271ce/24<br />waa24272ce/01<br />waa24272ce/08<br />waa24272ce/09<br />waa2427sce/20<br />waa2427sce/24<br />waa24280/01<br />waa24280/05<br />waa24280/08<br />waa2428sce/01<br />waa2428sce/08<br />waa2428sce/09<br />waa247mfn/01<br />waa247mfn/04<br />waa247mfn/05<br />waa247mnl/01<br />waa247mnl/04<br />waa28120/01<br />waa28120/04<br />waa28120/05<br />waa28120/07<br />waa28120/09<br />waa28160/01<br />waa28160/04<br />waa28160/09<br />waa28160be/01<br />waa28160be/04<br />waa28160be/05<br />waa28160be/07<br />waa28160be/09<br />waa28160be/11<br />waa28160be/15<br />waa28160be/24<br />waa28160be/29<br />waa28160be/32<br />waa28160be/33<br />waa28160fg/01<br />waa28160fg/04<br />waa28160fg/09<br />waa28160fn/01<br />waa28160fn/04<br />waa28160fn/05<br />waa28160fn/07<br />waa28160fn/09<br />waa28160fn/11<br />waa28160gb/01<br />waa28160gb/04<br />waa28160gb/09<br />waa28160nl/01<br />waa28160nl/04<br />waa28160nl/09<br />waa28160sn/01<br />waa28160sn/02<br />waa28160sn/03<br />waa28160sn/04<br />waa28160sn/08<br />waa28160sn/09<br />waa28160sn/10<br />waa28161/01<br />waa28161/04<br />waa28161/05<br />waa28161/07<br />waa28161/09<br />waa28161/11<br />waa28161fn/11<br />waa28161fn/13<br />waa28161fn/24<br />waa28161fn/29<br />waa28161fn/32<br />waa28161fn/33<br />waa28161gb/01<br />waa28161gb/07<br />waa28161gb/09<br />waa28161gb/11<br />waa28161sn/01<br />waa28161sn/06<br />waa28161sn/07<br />waa28161sn/09<br />waa28161sn/11<br />waa28161sn/13<br />waa28161sn/15<br />waa28162/01<br />waa28162/09<br />waa28162/11<br />waa28162/13<br />waa28162/24<br />waa28162/29<br />waa28162/32<br />waa28162/33<br />waa28162fn/11<br />waa28162fn/13<br />waa28162fn/24<br />waa28162sn/13<br />waa28162sn/24<br />waa28162sn/29<br />waa28163fn/24<br />waa28163fn/29<br />waa28163fn/32<br />waa28163fn/33<br />waa28163sn/01<br />waa28163sn/03<br />waa28163sn/05<br />waa28163sn/08<br />waa28163sn/09<br />waa28165gb/11<br />waa28165gb/24<br />waa28165gb/28<br />waa28165gb/29<br />waa28165nn/01<br />waa28165nn/02<br />waa28165nn/03<br />waa28165nn/04<br />waa28165nn/08<br />waa28165nn/09<br />waa28165nn/10<br />waa28166gb/24<br />waa28166gb/29<br />waa28166nn/01<br />waa28166nn/06<br />waa28166nn/07<br />waa28166nn/09<br />waa28166nn/11<br />waa28166nn/13<br />waa28166nn/15<br />waa28167gb/29<br />waa28167gb/32<br />waa28167gb/33<br />waa28168gb/29<br />waa28168gb/32<br />waa28168gb/33<br />waa28170sn/01<br />waa28170sn/02<br />waa28170sn/03<br />waa28170sn/04<br />waa28170sn/09<br />waa281e0sn/13<br />waa281e0sn/24<br />waa281e0sn/29<br />waa281e1sn/01<br />waa281e1sn/03<br />waa281e1sn/05<br />waa281e1sn/08<br />waa281e1sn/09<br />waa28220nl/01<br />waa28220nl/04<br />waa28220nl/05<br />waa28220nl/08<br />waa28220nl/09<br />waa28220nl/10<br />waa28222/09<br />waa28222/11<br />waa28222/13<br />waa28222/14<br />waa28222/24<br />waa28222/29<br />waa28222/32<br />waa28222/33<br />waa28222ch/29<br />waa28222ch/32<br />waa28222ch/33<br />waa28260/01<br />waa28260/04<br />waa28260/05<br />waa28260/08<br />waa28260/09<br />waa28260/10<br />waa28260ff/01<br />waa28260ff/04<br />waa28260ff/05<br />waa28260ff/08<br />waa28260ff/09<br />waa28260ff/10<br />waa28260fg/01<br />waa28260fg/05<br />waa28260fg/08<br />waa28260fg/09<br />waa28260fg/10<br />waa28260nl/01<br />waa28260nl/04<br />waa28260nl/05<br />waa28260nl/08<br />waa28260nl/09<br />waa28260nl/10<br />waa28260sk/01<br />waa28260sk/04<br />waa28260sk/05<br />waa28260sk/08<br />waa28260sk/09<br />waa28260sk/10<br />waa28261/01<br />waa28261/05<br />waa28261/08<br />waa28261/09<br />waa28261/10<br />waa28261fg/14<br />waa28261fg/24<br />waa28261fg/29<br />waa28261fg/32<br />waa28261fg/33<br />waa28261nl/14<br />waa28261nl/24<br />waa28261nl/29<br />waa28261nl/32<br />waa28261nl/33<br />waa28280/01<br />waa28280/05<br />waa28280/08<br />waa28280/09<br />waa28280nl/01<br />waa28280nl/04<br />waa28280nl/05<br />waa28280nl/08<br />waa28280nl/09<br />waa28280nl/10<br />wab12060by/01<br />wab12060by/02<br />wab12060by/03<br />wab12060by/04<br />wab12060by/05<br />wab12060by/07<br />wab12060by/08<br />wab12060tr/01<br />wab12060tr/02<br />wab12060tr/03<br />wab12060tr/04<br />wab12060tr/05<br />wab12060tr/07<br />wab12060tr/08<br />wab12060tr/12<br />wab12061tr/01<br />wab12061tr/20<br />wab12061tr/21<br />wab12061tr/23<br />wab12061tr/24<br />wab12061tr/25<br />wab12061tr/26<br />wab16010tr/01<br />wab16010tr/02<br />wab16010tr/03<br />wab16010tr/04<br />wab16010tr/05<br />wab16010tr/07<br />wab16010tr/08<br />wab16010tr/12<br />wab16060by/01<br />wab16060by/02<br />wab16060by/03<br />wab16060by/04<br />wab16060by/05<br />wab16060by/07<br />wab16060by/08<br />wab16060by/13<br />wab16060ii/01<br />wab16060ii/02<br />wab16060ii/03<br />wab16060ii/04<br />wab16060ii/05<br />wab16060ii/07<br />wab16060ii/08<br />wab16060il/01<br />wab16060il/05<br />wab16060il/07<br />wab16060il/08<br />wab16060il/20<br />wab16060il/21<br />wab16060il/23<br />wab16060il/24<br />wab16060il/25<br />wab16060il/27<br />wab16060in/01<br />wab16060in/08<br />wab16060in/10<br />wab16060in/14<br />wab16060in/17<br />wab16060in/21<br />wab16060in/23<br />wab16060in/24<br />wab16060in/25<br />wab16060in/27<br />wab16060me/01<br />wab16060me/05<br />wab16060me/07<br />wab16060me/08<br />wab16060tr/01<br />wab16060tr/02<br />wab16060tr/03<br />wab16060tr/04<br />wab16060tr/05<br />wab16060tr/07<br />wab16060tr/08<br />wab16060tr/12<br />wab16061me/01<br />wab16061me/20<br />wab16061me/21<br />wab16061me/23<br />wab16061me/24<br />wab16061me/25<br />wab16061tr/01<br />wab16061tr/20<br />wab16061tr/21<br />wab16061tr/23<br />wab16061tr/24<br />wab16061tr/25<br />wab16061tr/27<br />wab16063pl/01<br />wab16063pl/02<br />wab16063pl/03<br />wab16063pl/04<br />wab16063pl/05<br />wab16063pl/07<br />wab16063pl/08<br />wab1606sza/01<br />wab16071ce/01<br />wab16071ce/02<br />wab16071ce/03<br />wab16071ce/04<br />wab16071ce/05<br />wab16071ce/07<br />wab16071ce/08<br />wab16071ce/20<br />wab16071ce/21<br />wab16071ce/23<br />wab16071ce/24<br />wab16071ce/25<br />wab16071ce/27<br />wab16160in/01<br />wab16160in/02<br />wab16160in/03<br />wab16160in/04<br />wab16160in/05<br />wab16160in/07<br />wab16161in/01<br />wab16161in/10<br />wab16161in/11<br />wab16210tr/01<br />wab16210tr/02<br />wab16210tr/03<br />wab16210tr/04<br />wab16211tr/01<br />wab16212tr/01<br />wab16212tr/09<br />wab16260il/01<br />wab16260il/16<br />wab16260il/17<br />wab16260il/20<br />wab16260il/22<br />wab16260in/01<br />wab16260in/08<br />wab16260me/01<br />wab16260me/02<br />wab16260me/04<br />wab16260tr/01<br />wab16260tr/02<br />wab16260tr/03<br />wab16260tr/04<br />wab16261in/01<br />wab16261in/15<br />wab16261in/16<br />wab16261in/17<br />wab16261in/20<br />wab16261in/21<br />wab16261me/01<br />wab16261tr/01<br />wab16262me/01<br />wab16262me/15<br />wab16262me/16<br />wab16262me/17<br />wab16262me/20<br />wab16262me/21<br />wab16262me/22<br />wab16262tr/01<br />wab16262tr/09<br />wab16262tr/15<br />wab16262tr/16<br />wab16262tr/17<br />wab16262tr/20<br />wab16262tr/21<br />wab16262tr/22<br />wab16263tr/01<br />wab16263tr/21<br />wab16263tr/22<br />wab20060by/01<br />wab20060by/02<br />wab20060by/03<br />wab20060by/04<br />wab20060by/05<br />wab20060by/13<br />wab20060by/18<br />wab20060by/20<br />wab20060by/21<br />wab20060ee/01<br />wab20060ee/02<br />wab20060ee/03<br />wab20060ee/04<br />wab20060ee/05<br />wab20060ee/13<br />wab20060ee/18<br />wab20060ee/20<br />wab20060ee/21<br />wab20060ee/23<br />wab20060ee/24<br />wab20060gc/01<br />wab20060gc/03<br />wab20060gc/05<br />wab20060gr/01<br />wab20060gr/18<br />wab20060ii/01<br />wab20060ii/02<br />wab20060ii/03<br />wab20060ii/04<br />wab20060ii/05<br />wab20060il/01<br />wab20060il/05<br />wab20060il/18<br />wab20060il/20<br />wab20060il/21<br />wab20060il/23<br />wab20060il/24<br />wab20060il/27<br />wab20060sn/03<br />wab20060sn/04<br />wab20061by/01<br />wab20061by/20<br />wab20061by/21<br />wab20061by/23<br />wab20061by/24<br />wab20061by/27<br />wab20061gr/01<br />wab20061gr/20<br />wab20061gr/21<br />wab20061gr/23<br />wab20061gr/24<br />wab20061gr/27<br />wab20063pl/01<br />wab20063pl/02<br />wab20063pl/03<br />wab20063pl/04<br />wab20063pl/05<br />wab20063pl/13<br />wab20063pl/18<br />wab20064pl/01<br />wab20064pl/21<br />wab20064pl/23<br />wab20064pl/24<br />wab20064pl/27<br />wab20066ee/01<br />wab20066ee/23<br />wab20066ee/24<br />wab20066ee/27<br />wab2006sbc/01<br />wab2006sbc/02<br />wab2006sbc/03<br />wab2006sbc/05<br />wab2006sbc/06<br />wab20071ce/01<br />wab20071ce/02<br />wab20071ce/03<br />wab20071ce/04<br />wab20071ce/05<br />wab20071ce/18<br />wab20071ce/20<br />wab20071ce/21<br />wab20071ce/23<br />wab20071ce/24<br />wab2007kpl/01<br />wab2007kpl/02<br />wab2007kpl/03<br />wab2007kpl/04<br />wab2007kpl/05<br />wab20082ce/01<br />wab20082ce/02<br />wab20082ce/03<br />wab20082ce/04<br />wab20082ce/05<br />wab2021jpl/01<br />wab2021jpl/12<br />wab2021jpl/15<br />wab2021jpl/16<br />wab2021jpl/17<br />wab2021jpl/20<br />wab2021jpl/21<br />wab2021jpl/22<br />wab20260by/01<br />wab20260by/02<br />wab20260by/03<br />wab20260by/04<br />wab20260ee/01<br />wab20260ee/02<br />wab20260ee/03<br />wab20260ee/04<br />wab20260gc/01<br />wab20260gc/16<br />wab20260gc/17<br />wab20260gc/20<br />wab20260gc/21<br />wab20260gc/22<br />wab20260gr/01<br />wab20260ii/01<br />wab20260il/01<br />wab20260il/20<br />wab20260il/21<br />wab20260me/01<br />wab20260me/02<br />wab20260me/04<br />wab20260tr/01<br />wab20260tr/02<br />wab20260tr/03<br />wab20260tr/04<br />wab20261by/01<br />wab20261ee/01<br />wab20261ee/02<br />wab20261ii/01<br />wab20261ii/12<br />wab20261ii/15<br />wab20261ii/16<br />wab20261ii/17<br />wab20261ii/20<br />wab20261ii/21<br />wab20261ii/22<br />wab20261ii/23<br />wab20261me/01<br />wab20261me/05<br />wab20261tr/01<br />wab20262by/01<br />wab20262by/15<br />wab20262by/16<br />wab20262by/17<br />wab20262by/20<br />wab20262by/21<br />wab20262by/22<br />wab20262ir/01<br />wab20262me/01<br />wab20262me/15<br />wab20262me/16<br />wab20262me/17<br />wab20262me/20<br />wab20262me/21<br />wab20262me/22<br />wab20262pl/01<br />wab20262pl/02<br />wab20262pl/03<br />wab20262pl/04<br />wab20262tr/01<br />wab20262tr/09<br />wab20262tr/15<br />wab20262tr/16<br />wab20262tr/17<br />wab20262tr/20<br />wab20262tr/21<br />wab20262tr/22<br />wab20263pl/01<br />wab20264pl/01<br />wab20264pl/12<br />wab20264pl/15<br />wab20264pl/16<br />wab20264pl/17<br />wab20264pl/20<br />wab20264pl/21<br />wab20264pl/22<br />wab20264tr/01<br />wab20266ee/01<br />wab20266ee/15<br />wab20266ee/16<br />wab20266ee/17<br />wab20266ee/20<br />wab20266ee/21<br />wab20266ee/22<br />wab20267in/01<br />wab20267in/29<br />wab20268in/01<br />wab20268za/01<br />wab2026apl/01<br />wab2026fpl/01<br />wab2026fpl/02<br />wab2026fpl/03<br />wab2026fpl/04<br />wab2026kpl/01<br />wab2026kpl/02<br />wab2026kpl/03<br />wab2026kpl/04<br />wab2026ppl/01<br />wab2026ppl/12<br />wab2026ppl/15<br />wab2026ppl/16<br />wab2026ppl/17<br />wab2026ppl/20<br />wab2026ppl/21<br />wab2026ppl/22<br />wab2026qpl/01<br />wab2026qpl/12<br />wab2026qpl/15<br />wab2026qpl/16<br />wab2026qpl/17<br />wab2026qpl/20<br />wab2026qpl/21<br />wab2026qpl/22<br />wab2026ske/01<br />wab2026ske/27<br />wab2026ske/32<br />wab2026sme/01<br />wab2026sme/02<br />wab2026sme/03<br />wab2026sme/05<br />wab2026sme/10<br />wab2026spl/01<br />wab2026spl/04<br />wab2026sza/01<br />wab2026sza/03<br />wab2026sza/07<br />wab2026sza/17<br />wab2026sza/20<br />wab2026sza/21<br />wab2026tpl/01<br />wab2026tpl/12<br />wab2026tpl/15<br />wab2026tpl/16<br />wab2026tpl/17<br />wab2026tpl/20<br />wab2026tpl/21<br />wab2026tpl/22<br />wab2026ypl/01<br />wab2026ypl/12<br />wab2026ypl/15<br />wab2026ypl/16<br />wab2026ypl/17<br />wab2026ypl/20<br />wab2026ypl/21<br />wab20272ce/01<br />wab20272ce/02<br />wab20272ce/03<br />wab20272ce/04<br />wab20272ce/10<br />wab20272ce/13<br />wab20272ce/14<br />wab20272ce/15<br />wab20272ce/16<br />wab20272ce/17<br />wab20272ce/18<br />wab2027fpl/01<br />wab2027kpl/01<br />wab2027sme/01<br />wab2027sme/17<br />wab2027sme/20<br />wab2027sme/21<br />wab2027spl/01<br />wab2028fpl/01<br />wab2028fpl/12<br />wab2028fpl/15<br />wab2028fpl/16<br />wab2028fpl/17<br />wab2028fpl/20<br />wab2028fpl/21<br />wab2028fpl/22<br />wab2028jpl/01<br />wab2028jpl/02<br />wab2028jpl/03<br />wab2028jpl/04<br />wab2028kpl/01<br />wab2028kpl/12<br />wab2028kpl/15<br />wab2028kpl/16<br />wab2028kpl/17<br />wab2028kpl/20<br />wab2028kpl/21<br />wab2028kpl/22<br />wab2028spl/01<br />wab2028spl/12<br />wab2028spl/15<br />wab2028spl/16<br />wab2028spl/17<br />wab2028spl/20<br />wab2028spl/21<br />wab2028spl/22<br />wab2029jpl/01<br />wab202s0tr/01<br />wab202s0tr/02<br />wab202s0tr/03<br />wab202s0tr/05<br />wab202s1me/01<br />wab202s1me/20<br />wab202s1me/21<br />wab202s1me/23<br />wab202s1tr/01<br />wab202s2ir/01<br />wab202s2me/01<br />wab202s2tr/01<br />wab202s2tr/09<br />wab22066ee/01<br />wab22066ee/20<br />wab22066ee/21<br />wab22066ee/23<br />wab22066ee/24<br />wab22066ee/27<br />wab24060/01<br />wab24060/02<br />wab24060/03<br />wab24060/04<br />wab24060/05<br />wab24060by/01<br />wab24060by/02<br />wab24060by/03<br />wab24060by/04<br />wab24060by/05<br />wab24060gb/01<br />wab24060gb/02<br />wab24060gb/03<br />wab24060gb/05<br />wab24060gb/11<br />wab24060gb/18<br />wab24060sn/01<br />wab24060sn/05<br />wab24063pl/01<br />wab24063pl/02<br />wab24063pl/03<br />wab24063pl/04<br />wab24063pl/05<br />wab24066ee/01<br />wab24066ee/18<br />wab24161gb/01<br />wab24161gb/02<br />wab24161gb/03<br />wab24161gb/04<br />wab24161gb/05<br />wab24161gb/07<br />wab24161gb/08<br />wab24166sn/01<br />wab24166sn/02<br />wab24166sn/03<br />wab24166sn/04<br />wab24166sn/05<br />wab24166sn/07<br />wab24166sn/08<br />wab24210ff/01<br />wab24211ff/01<br />wab24211ff/16<br />wab24211ff/17<br />wab24211ff/20<br />wab24211ff/22<br />wab24220/01<br />wab24220/02<br />wab24220/03<br />wab24220/04<br />wab24260by/01<br />wab24260by/02<br />wab24260by/03<br />wab24260by/04<br />wab24260ee/01<br />wab24260ee/02<br />wab24260ee/03<br />wab24260ee/04<br />wab24260gb/03<br />wab24260gb/09<br />wab24260gr/01<br />wab24260gr/15<br />wab24260gr/16<br />wab24260gr/17<br />wab24260gr/20<br />wab24260gr/21<br />wab24260gr/22<br />wab24260il/01<br />wab24260il/20<br />wab24260sn/01<br />wab24260sn/02<br />wab24260sn/03<br />wab24260sn/04<br />wab24261by/01<br />wab24261ee/01<br />wab24261ee/02<br />wab24261sn/01<br />wab24262by/01<br />wab24262by/15<br />wab24262by/16<br />wab24262by/17<br />wab24262by/20<br />wab24262by/21<br />wab24262by/22<br />wab24262gb/01<br />wab24262gb/15<br />wab24262gb/16<br />wab24262gb/17<br />wab24262gb/20<br />wab24262gb/21<br />wab24262gb/22<br />wab24262pl/01<br />wab...
</div>

After

txt
Cette pompe de vidange est une pièce adaptable pour les lave-linge de la marque Bosch et Siemens. 
Les références compatibles sont 00144192, 00144484, 00144305 et 00145787. Elle permet de vidanger rapidement l'eau usée du cycle de lavage. 
Compacte et facile à installer, elle est fabriquée avec des matériaux de qualité pour une résistance à long terme. 
Ne vous inquiétez plus des fuites ou des problèmes de vidange, optez pour cette pièce de rechange de qualité pour votre lave-linge Bosch ou Siemens.

What can we learn from this experiment? ​

This first POC produced some impressive results, especially given the time we had to invest to get it done. We have been able to demonstrate that LLM models are capable of delivering substantial value to our customers, by responding to a real-life use case. However, it is clear that this approach also has many constraints and flaws.

In a few words:

  • The final result was of sufficient quality to be used by Fnac/Darty (after a thorough check of the content produced). To date, two translation batches have been processed, and we've been able to improve our algorithm and the prompt used between each treatment.
  • Adjusting the prompt communicated to the model is key, and huge improvements are achieved by improving it after each iteration.
  • LLM models should be taken for what they are: language processing models that generate text that looks like the text on which they have been trained. This implies that errors may have been introduced, and it therefore seems absolutely essential to carry out a manual check to verify the quality of what has been produced. This is all the more true in the case of information that will then be presented to a consumer. (It should also be noted that, although we have not yet encountered this case, any type of error can be expected, including the introduction of content that is offensive to the user.)
  • I've noticed that the answer given is always either very true or completely false. In other words, if the model goes in the right direction, the result is often of good quality, but if it doesn't go in the right direction, the result is often completely incoherent. So it's easy to spot the more obvious errors, and complicated to detect the more subtle ones.
  • As for the OpenAI platform, it was a pleasure to use. The documentation is very complete, and the API is very fast to familiarize yourself with (see the links at the end of this document).
  • As an indication, it costs us $3.5 to produce a thousand descriptions. OpenAI services are obviously priced on a consumption basis (a few cents per thousand tokens ingested and produced). The API also has certain limitations (notably in terms of the number of calls per minute we can make). These limitations may be lifted in the future if we decide to use this tool more widely.

Sources ​