How to get list of files/directories of an directory URL?

by

There are some conditions:

  1. The server must have enabled directory listing in order for you to see the content of it.
  2. There is no way I know of (no API or HTTP verb) to retrieve the listing, and so the listing is generally shown as a normal HTML page
  3. You will have to parse this HTML page in order to find the entries.

The parsing can be done easily using a lib like JSoup.

For example, using JSoup you can fetch the documents at url http://howto.unixdev.net/ like this:

import java.io.IOException;

import org.jsoup.Jsoup;
import org.jsoup.nodes.Document;
import org.jsoup.nodes.Element;

public class Sample {
    public static void main(String[] args) throws IOException {
        Document doc = Jsoup.connect("http://howto.unixdev.net").get();
        for (Element file : doc.select("td.right td a")) {
            System.out.println(file.attr("href"));
        }
    }
}

Will output:

beignets.html
beignets.pdf
bsd-pam-ldap.html
ddns-updates.html
Debian_on_HP_dv6z.html
dextop-slackware.html
dirlist.html
downloads/
ldif/
Linux-SharePoint.html
rhfc3-apt.html
rhfc3-apt.tar.bz2
SUNWdsee-Debian.html
SUNWdtdte-b69.html
SUNWdtdte-b69.tar.bz2
tcshrc.html
Test_LVM_Trim_Ext4.html
Tru64-CS20-HOWTO.html

As for your sample url http://java.sun.com/j2se/1.5/pdf this is a page not found, so I think you’re out of luck.

More Related Contents:

  1. How to use a servlet filter in Java to change an incoming servlet request url?
  2. How to construct a relative path in Java from two absolute paths (or URLs)?
  3. Parsing query strings on Android
  4. URL to load resources from the classpath in Java
  5. Java – How to find the redirected url of a url?
  6. Preferred Java way to ping an HTTP URL for availability
  7. Java – class.getResource returns null
  8. Get domain name from given url
  9. How do I make an http request using cookies on Android?
  10. How to access resources in JAR file?
  11. Getting URL parameter in java and extract a specific text from that URL
  12. Registering and using a custom java.net.URL protocol
  13. How to check if a URL exists or returns 404 with Java?
  14. Pass a local file in to URL in Java
  15. How to check for a valid URL in Java?
  16. How to obtain the last path segment of a URI
  17. Check if file exists on remote server using its URL [duplicate]
  18. Android: how to parse URL String with spaces to URI object?
  19. What’s the difference between a Resource, URI, URL, Path and File in Java?
  20. Java HttpServletRequest get URL in browsers URL bar
  21. Get file name from URL
  22. java.net.URL read stream to byte[]
  23. Safe use of HttpURLConnection
  24. InputStream from a URL
  25. how to get the base url from jsp request object?
  26. How to use Selenium WebDriver on local webpage (on my PC) instead of one located somewhere online?
  27. @PathVariable in SpringBoot with slashes in URL
  28. how to send an array in url request
  29. Checking if a URL exists or not
  30. Encode URL query parameters

Leave a Comment