Removing duplicate elements with XSLT

by

I. XSLT 1.0 solution:

Here is a solution using Muenchian grouping:

<xsl:stylesheet version="1.0"
 xmlns:xsl="http://www.w3.org/1999/XSL/Transform">
 <xsl:output omit-xml-declaration="yes" indent="yes"/>
 <xsl:strip-space elements="*"/>

 <xsl:key name="kLineById" match="Line" use="ItemID|ITEMID"/>

 <xsl:template match="node()|@*">
     <xsl:copy>
       <xsl:apply-templates select="node()|@*"/>
     </xsl:copy>
 </xsl:template>

 <xsl:template match=
  "Line[not(generate-id() = generate-id(key('kLineById', ItemID|ITEMID)[1]))]"
  />
</xsl:stylesheet>

Do Note:

  1. Muenchian grouping is the most efficient known general grouping method for XSLT 1.0.

  2. Pure “push” style used.

II. XSLT 2.0 solution:

<xsl:stylesheet version="2.0"
    xmlns:xsl="http://www.w3.org/1999/XSL/Transform">
    <xsl:output omit-xml-declaration="yes" indent="yes"/>

 <xsl:template match="/*">
     <XML>
       <xsl:for-each-group select="Line" group-by="ItemID | ITEMID">
         <xsl:sequence select="."/>
       </xsl:for-each-group>
     </XML>
 </xsl:template>
</xsl:stylesheet>

Both solutions, when applied on the provided XML document:

<XML>
        <Line>
            <SupplierID>Waltons</SupplierID>
            <InvoiceID>CAP600795SI</InvoiceID>
            <InvoiceDate>20100506</InvoiceDate>
            <ItemID>723073</ItemID>
            <ColorID>02</ColorID>
            <Description>Pentel LR7 Energel Metal Tip Refill 0.7mm</Description>
            <MainCategory>WRITING INSTRUMENTS</MainCategory>
            <SubCategory>Refill</SubCategory>
            <LineNum>               1.0000000</LineNum>
            <Qty>               6.0000000</Qty>
            <UnitPriceExclTax>              10.0200000</UnitPriceExclTax>
            <LineTax>               8.4200000</LineTax>
            <LinePriceExclTax>              60.1200000</LinePriceExclTax>
            <ColorName>Black</ColorName>
            <UOM>EA</UOM>
            <Backorder>               0.0000000</Backorder>
            <INVENTTRANSID>      CAP5637542_060</INVENTTRANSID>
        </Line>
        <Line>
            <SupplierID>Waltons</SupplierID>
            <InvoiceID>CAP600795SI</InvoiceID>
            <InvoiceDate>20100506</InvoiceDate>
            <ItemID>903420</ItemID>
            <ColorID />
            <Description>STEPHENS JUNIOR Stapler Half Strip KW586</Description>
            <MainCategory>OFFICE SUNDRIES</MainCategory>
            <SubCategory>Staplers</SubCategory>
            <LineNum>               2.0000000</LineNum>
            <Qty>               3.0000000</Qty>
            <UnitPriceExclTax>              32.2500000</UnitPriceExclTax>
            <LineTax>              13.5400000</LineTax>
            <LinePriceExclTax>              96.7500000</LinePriceExclTax>
            <ColorName />
            <UOM>Ea</UOM>
            <Backorder>               0.0000000</Backorder>
            <INVENTTRANSID>      CAP5637547_060</INVENTTRANSID>
        </Line>
        <Line>
            <SupplierID>Waltons</SupplierID>
            <InvoiceID>CAP600795SI</InvoiceID>
            <InvoiceDate>20100506</InvoiceDate>
            <ItemID>867241</ItemID>
            <ColorID />
            <Description>TRODAT PRINTY S/Inking Stamp Copy 4911</Description>
            <MainCategory>STAMPS DATERS NUMBERERS</MainCategory>
            <SubCategory>Self Inking Stamps</SubCategory>
            <LineNum>               3.0000000</LineNum>
            <Qty>               1.0000000</Qty>
            <UnitPriceExclTax>              42.1500000</UnitPriceExclTax>
            <LineTax>               5.9000000</LineTax>
            <LinePriceExclTax>              42.1500000</LinePriceExclTax>
            <ColorName />
            <UOM>Ea</UOM>
            <Backorder>               1.0000000</Backorder>
            <INVENTTRANSID>      CAP5637548_060</INVENTTRANSID>
        </Line>
        <Line>
            <SupplierID>Waltons</SupplierID>
            <InvoiceID>CAP600795SI</InvoiceID>
            <InvoiceDate>20100506</InvoiceDate>
            <ItemID>941151</ItemID>
            <ColorID />
            <Description>PENTEL Correction Tape 5mx5mm ZT35</Description>
            <MainCategory>OFFICE SUNDRIES</MainCategory>
            <SubCategory>Correction Fluid/Pens/Tape</SubCategory>
            <LineNum>               4.0000000</LineNum>
            <Qty>               2.0000000</Qty>
            <UnitPriceExclTax>              25.1500000</UnitPriceExclTax>
            <LineTax>               7.0400000</LineTax>
            <LinePriceExclTax>              50.3000000</LinePriceExclTax>
            <ColorName />
            <UOM>Ea</UOM>
            <Backorder>               0.0000000</Backorder>
            <INVENTTRANSID>      CAP5637549_060</INVENTTRANSID>
        </Line>
        <Line>
            <SupplierID>Waltons</SupplierID>
            <InvoiceID>CAP600795SI</InvoiceID>
            <InvoiceDate>20100506</InvoiceDate>
            <ItemID>801215</ItemID>
            <ColorID />
            <Description>MONDI ROTATRIM Copy Paper A4 80Gsm White</Description>
            <MainCategory>A4 Paper</MainCategory>
            <SubCategory>White Bond Paper</SubCategory>
            <LineNum>               5.0000000</LineNum>
            <Qty>             100.0000000</Qty>
            <UnitPriceExclTax>              29.0100000</UnitPriceExclTax>
            <LineTax>             406.1400000</LineTax>
            <LinePriceExclTax>            2901.0000000</LinePriceExclTax>
            <ColorName />
            <UOM>Pkt 500</UOM>
            <Backorder>               0.0000000</Backorder>
            <INVENTTRANSID>      CAP5637552_060</INVENTTRANSID>
        </Line>
        <Line>
            <SALESID>         CAP716197SO</SALESID>
            <INVOICEID>         CAP600795SI</INVOICEID>
            <INVOICEDATE>2010/05/06</INVOICEDATE>
            <NUMBERSEQUENCEGROUP />
            <LINENUM>               2.0000000</LINENUM>
            <ITEMID>805236</ITEMID>
            <INVENTDIMID>      CAP0000594_061</INVENTDIMID>
            <NAME>Ruled Paper A4 Fnt/Marg JD76</NAME>
            <CONFIRMEDDLV>2010/05/06</CONFIRMEDDLV>
            <INVENTTRANSID>      CAP5637543_060</INVENTTRANSID>
            <QTYSALES>               4.0000000</QTYSALES>
            <QTYORDERED>               4.0000000</QTYORDERED>
            <QTYBACKORDERSALES>               4.0000000</QTYBACKORDERSALES>
            <QTYBACKORDERINVENT>               4.0000000</QTYBACKORDERINVENT>
            <SALESUNIT>EA</SALESUNIT>
            <ORIGSALESID>         CAP716197SO</ORIGSALESID>
            <DATAAREAID>wal</DATAAREAID>
            <RECID>622392608</RECID>
            <RecVersion>1</RecVersion>
        </Line>
        <Line>
            <SALESID>         CAP716197SO</SALESID>
            <INVOICEID>         CAP600795SI</INVOICEID>
            <INVOICEDATE>2010/05/06</INVOICEDATE>
            <NUMBERSEQUENCEGROUP />
            <LINENUM>               3.0000000</LINENUM>
            <ITEMID>941150</ITEMID>
            <INVENTDIMID>      CAP0000594_061</INVENTDIMID>
            <NAME>PENGUIN Correction Fluid 20ml White</NAME>
            <CONFIRMEDDLV>2010/05/06</CONFIRMEDDLV>
            <INVENTTRANSID>      CAP5637546_060</INVENTTRANSID>
            <QTYSALES>               6.0000000</QTYSALES>
            <QTYORDERED>               6.0000000</QTYORDERED>
            <QTYBACKORDERSALES>               6.0000000</QTYBACKORDERSALES>
            <QTYBACKORDERINVENT>               6.0000000</QTYBACKORDERINVENT>
            <SALESUNIT>EA</SALESUNIT>
            <ORIGSALESID>         CAP716197SO</ORIGSALESID>
            <DATAAREAID>wal</DATAAREAID>
            <RECID>622392609</RECID>
            <RecVersion>1</RecVersion>
        </Line>
        <Line>
            <SALESID>         CAP716197SO</SALESID>
            <INVOICEID>         CAP600795SI</INVOICEID>
            <INVOICEDATE>2010/05/06</INVOICEDATE>
            <NUMBERSEQUENCEGROUP />
            <LINENUM>               5.0000000</LINENUM>
            <ITEMID>867241</ITEMID>
            <INVENTDIMID>      CAP0000594_061</INVENTDIMID>
            <NAME>TRODAT PRINTY S/Inking Stamp Copy 4911</NAME>
            <CONFIRMEDDLV>2010/05/06</CONFIRMEDDLV>
            <INVENTTRANSID>      CAP5637548_060</INVENTTRANSID>
            <QTYSALES>               2.0000000</QTYSALES>
            <QTYORDERED>               2.0000000</QTYORDERED>
            <QTYBACKORDERSALES>               1.0000000</QTYBACKORDERSALES>
            <QTYBACKORDERINVENT>               1.0000000</QTYBACKORDERINVENT>
            <SALESUNIT>EA</SALESUNIT>
            <ORIGSALESID>         CAP716197SO</ORIGSALESID>
            <DATAAREAID>wal</DATAAREAID>
            <RECID>622392610</RECID>
            <RecVersion>1</RecVersion>
        </Line>
</XML>

produce the wanted, correct result:

<XML>
   <Line>
            <SupplierID>Waltons</SupplierID>
            <InvoiceID>CAP600795SI</InvoiceID>
            <InvoiceDate>20100506</InvoiceDate>
            <ItemID>723073</ItemID>
            <ColorID>02</ColorID>
            <Description>Pentel LR7 Energel Metal Tip Refill 0.7mm</Description>
            <MainCategory>WRITING INSTRUMENTS</MainCategory>
            <SubCategory>Refill</SubCategory>
            <LineNum>               1.0000000</LineNum>
            <Qty>               6.0000000</Qty>
            <UnitPriceExclTax>              10.0200000</UnitPriceExclTax>
            <LineTax>               8.4200000</LineTax>
            <LinePriceExclTax>              60.1200000</LinePriceExclTax>
            <ColorName>Black</ColorName>
            <UOM>EA</UOM>
            <Backorder>               0.0000000</Backorder>
            <INVENTTRANSID>      CAP5637542_060</INVENTTRANSID>
        </Line>
   <Line>
            <SupplierID>Waltons</SupplierID>
            <InvoiceID>CAP600795SI</InvoiceID>
            <InvoiceDate>20100506</InvoiceDate>
            <ItemID>903420</ItemID>
            <ColorID/>
            <Description>STEPHENS JUNIOR Stapler Half Strip KW586</Description>
            <MainCategory>OFFICE SUNDRIES</MainCategory>
            <SubCategory>Staplers</SubCategory>
            <LineNum>               2.0000000</LineNum>
            <Qty>               3.0000000</Qty>
            <UnitPriceExclTax>              32.2500000</UnitPriceExclTax>
            <LineTax>              13.5400000</LineTax>
            <LinePriceExclTax>              96.7500000</LinePriceExclTax>
            <ColorName/>
            <UOM>Ea</UOM>
            <Backorder>               0.0000000</Backorder>
            <INVENTTRANSID>      CAP5637547_060</INVENTTRANSID>
        </Line>
   <Line>
            <SupplierID>Waltons</SupplierID>
            <InvoiceID>CAP600795SI</InvoiceID>
            <InvoiceDate>20100506</InvoiceDate>
            <ItemID>867241</ItemID>
            <ColorID/>
            <Description>TRODAT PRINTY S/Inking Stamp Copy 4911</Description>
            <MainCategory>STAMPS DATERS NUMBERERS</MainCategory>
            <SubCategory>Self Inking Stamps</SubCategory>
            <LineNum>               3.0000000</LineNum>
            <Qty>               1.0000000</Qty>
            <UnitPriceExclTax>              42.1500000</UnitPriceExclTax>
            <LineTax>               5.9000000</LineTax>
            <LinePriceExclTax>              42.1500000</LinePriceExclTax>
            <ColorName/>
            <UOM>Ea</UOM>
            <Backorder>               1.0000000</Backorder>
            <INVENTTRANSID>      CAP5637548_060</INVENTTRANSID>
        </Line>
   <Line>
            <SupplierID>Waltons</SupplierID>
            <InvoiceID>CAP600795SI</InvoiceID>
            <InvoiceDate>20100506</InvoiceDate>
            <ItemID>941151</ItemID>
            <ColorID/>
            <Description>PENTEL Correction Tape 5mx5mm ZT35</Description>
            <MainCategory>OFFICE SUNDRIES</MainCategory>
            <SubCategory>Correction Fluid/Pens/Tape</SubCategory>
            <LineNum>               4.0000000</LineNum>
            <Qty>               2.0000000</Qty>
            <UnitPriceExclTax>              25.1500000</UnitPriceExclTax>
            <LineTax>               7.0400000</LineTax>
            <LinePriceExclTax>              50.3000000</LinePriceExclTax>
            <ColorName/>
            <UOM>Ea</UOM>
            <Backorder>               0.0000000</Backorder>
            <INVENTTRANSID>      CAP5637549_060</INVENTTRANSID>
        </Line>
   <Line>
            <SupplierID>Waltons</SupplierID>
            <InvoiceID>CAP600795SI</InvoiceID>
            <InvoiceDate>20100506</InvoiceDate>
            <ItemID>801215</ItemID>
            <ColorID/>
            <Description>MONDI ROTATRIM Copy Paper A4 80Gsm White</Description>
            <MainCategory>A4 Paper</MainCategory>
            <SubCategory>White Bond Paper</SubCategory>
            <LineNum>               5.0000000</LineNum>
            <Qty>             100.0000000</Qty>
            <UnitPriceExclTax>              29.0100000</UnitPriceExclTax>
            <LineTax>             406.1400000</LineTax>
            <LinePriceExclTax>            2901.0000000</LinePriceExclTax>
            <ColorName/>
            <UOM>Pkt 500</UOM>
            <Backorder>               0.0000000</Backorder>
            <INVENTTRANSID>      CAP5637552_060</INVENTTRANSID>
        </Line>
   <Line>
            <SALESID>         CAP716197SO</SALESID>
            <INVOICEID>         CAP600795SI</INVOICEID>
            <INVOICEDATE>2010/05/06</INVOICEDATE>
            <NUMBERSEQUENCEGROUP/>
            <LINENUM>               2.0000000</LINENUM>
            <ITEMID>805236</ITEMID>
            <INVENTDIMID>      CAP0000594_061</INVENTDIMID>
            <NAME>Ruled Paper A4 Fnt/Marg JD76</NAME>
            <CONFIRMEDDLV>2010/05/06</CONFIRMEDDLV>
            <INVENTTRANSID>      CAP5637543_060</INVENTTRANSID>
            <QTYSALES>               4.0000000</QTYSALES>
            <QTYORDERED>               4.0000000</QTYORDERED>
            <QTYBACKORDERSALES>               4.0000000</QTYBACKORDERSALES>
            <QTYBACKORDERINVENT>               4.0000000</QTYBACKORDERINVENT>
            <SALESUNIT>EA</SALESUNIT>
            <ORIGSALESID>         CAP716197SO</ORIGSALESID>
            <DATAAREAID>wal</DATAAREAID>
            <RECID>622392608</RECID>
            <RecVersion>1</RecVersion>
        </Line>
   <Line>
            <SALESID>         CAP716197SO</SALESID>
            <INVOICEID>         CAP600795SI</INVOICEID>
            <INVOICEDATE>2010/05/06</INVOICEDATE>
            <NUMBERSEQUENCEGROUP/>
            <LINENUM>               3.0000000</LINENUM>
            <ITEMID>941150</ITEMID>
            <INVENTDIMID>      CAP0000594_061</INVENTDIMID>
            <NAME>PENGUIN Correction Fluid 20ml White</NAME>
            <CONFIRMEDDLV>2010/05/06</CONFIRMEDDLV>
            <INVENTTRANSID>      CAP5637546_060</INVENTTRANSID>
            <QTYSALES>               6.0000000</QTYSALES>
            <QTYORDERED>               6.0000000</QTYORDERED>
            <QTYBACKORDERSALES>               6.0000000</QTYBACKORDERSALES>
            <QTYBACKORDERINVENT>               6.0000000</QTYBACKORDERINVENT>
            <SALESUNIT>EA</SALESUNIT>
            <ORIGSALESID>         CAP716197SO</ORIGSALESID>
            <DATAAREAID>wal</DATAAREAID>
            <RECID>622392609</RECID>
            <RecVersion>1</RecVersion>
        </Line>
</XML>

More Related Contents:

  1. XSL – rounding/format-number problem
  2. XSLT Transform doesn’t work until I remove root node
  3. XSLT not working in web browser
  4. Can Chrome be made to perform an XSL transform on a local file?
  5. Current node vs. Context node in XSLT/XPath?
  6. How to save newlines in XML attribute?
  7. How to change or reassign a variable in XSLT?
  8. split function in xslt 1.0
  9. XSLT: How to convert XML Node to String
  10. Add CDATA to an xml file
  11. How to mimic copy-namespaces=”no” in XSLT 1.0?
  12. Finding the difference between two dateTimes in XSLT
  13. How to unescape XML characters with help of XSLT?
  14. how to Merge two xml files with XSLT
  15. XSLT Replace function not found
  16. What is the difference between ‘or’ and ‘|’ when programming in xslt?
  17. XSL xsl:template match=”/”
  18. Concatenate multiple node values in xpath
  19. how to find the current date in XSLT 1.0
  20. Preserving entity references when transforming XML with XSLT?
  21. WiX Installer: using xslt with heat.exe to update attributes
  22. In XSLT how do you test to see if a variable exists?
  23. How to use node-set function in a platform-independent way?
  24. Need help in creating XSLT, i do have Source and Target XML
  25. Format XML code in Eclipse
  26. Including an XML file in an XML/XSL file
  27. XSLT: Select following-sibling until reaching a specified tag
  28. XSLT – How to keep only wanted elements from XML
  29. XSLT Transformation – dynamic element names
  30. Converting XML elements to XML attributes using XSLT

Leave a Comment