BrokenLinks 3.1 build: 9639 released: 2017-03-15 compiled with: Java 1.8.0_131 Jet jet12.0-pro-x86/1.8.0_131

tracks and repairs broken links and redirected links in conjunction with Xenu. Also includes utility to tidy URLs on a website..

Copyright: (c) 2008-2017 Canadian Mind Products.

Java application.
Download from: http://mindprod.com/products1.html#BROKENLINKS
View formatted HTML Manual online at: http://mindprod.com/application/brokenlinks.manual.html

----

Notes:

You must install the Java JRE to use this program.
See http://mindprod.com/jgloss/jgloss/jre.html

This program can only be used from the command prompt, (or via an command
line style icon shortcut) e.g. under Windows command.exe or JPSoft
tcmd.exe, formerly called the DOS box. Just clicking the programs in a
directory listing will not do anything useful. Just typing the program
names at the command prompt will not either.

This program requires a manual install! See below.

This program works with vanilla text files, (e.g. ASCII files or UTF-8
Unicode files). You will need a text editor to create and view them, not a word
processor. e.g. notepad, Visual Slick Edit or other suitable text editor
http://mindprod.com/jgloss/editor.html. You must use a monospaced font
http://mindprod.com/jgloss/monospacedfonts.html (aka fixed pitch, aka
programmer font) to view your files, or they won't look properly aligned.

I put out an avalanche of free software into the world, and submit PAD
files to hundreds of distribution sites, but I rarely hear back from
anyone.  What's happening?  Does it all just work fine?  It is so
complicated nobody can figure out how to use it and they give up on it?
It is it useful?  Since everyone has the source, do people just fix the
programs to their liking themselves?  Did you have trouble installing?  Do
I presume you know too much?  I would be happy to hear from you about your
experiences, positive or negative and your requests for improvements.  A
one-line email to roedy@mindprod.com would be great.

===> Free <===
Full source included.
You may even include the source code, modified or unmodified
in free/commercial open source/proprietary programs that you write and distribute.
May be used freely for any purpose but military.
For more details on this restriction, see
http://mindprod.com/contact/nonmil.html
If you include any Canadian Mind Products code in your own applications,
your app too must be labelled non-military use only.
http://mindprod.com/contact/nonmil.html
All Java jars and source code are included. If you need the class files or Javadoc, you will have to build them yourself. To streamline the zip downloads, class files and Javadoc have been removed.

----

Prerequisites:

This program runs under any OS that supports Java,
(e.g.W2K/XP/W2003/Vista/W2008/W7-32/W7-64/W8-32/W8-64/Linux/LinuxARM/LinuxX86
/LinuxX64/Ubuntu/Solaris/SolarisSPARC/SolarisSPARC64/SolarisX86/SolarisX64/OSX/AIX...)
so long as you have
<><> Java version 1.8 <><> or later installed (32-bit or 64-bit Java).
See http://mindprod.com/jgloss/installingjava.html for details.

----

Installing on a PC:

Download source and compiled jar files to run on your own machine as an application.
First install a recent Java JDK or JVM.
See http://mindprod.com/jgloss/installingjava.html.
To install, extract the zip download with WinZip
(or similar unzip utility) into any directory you please,
often J:\ --  ticking off the <span class="click">use folder names</span> option.
To run as an application, type:
java.exe %JAVA_OPTIONS -ea -jar J:\com\mindprod\brokenlinks\brokenlinks.jar {put any parms here}

adjusting as necessary to account for where the jar file is.

----

Installing on a MacIntosh:

Use Safari to download source and compiled jar files to run on your own machine as an application.
Safari will automatically unpack the zip into ~/Downloads (version 10.5)
[or on the Desktop (version 10.4 and earlier)].
First install a recent Java JDK or JVM.
See http://mindprod.com/jgloss/installingjava.html.
You may optionally move the download tree to a permanent home.
I don't have a MacIntosh, just a PC, so I can't test my Java programs for Mac compatibility.
In theory they should work without problems, but in practice that does not always happen.
If you have problems please, let me know, preferably with screenshots and complete verbatim error messages.
To run as an application, without parameters, just double click the jar file.

To run as an application with parameters, in bash shell type:
open Terminal.app
cd ~/Desktop
java.exe -ea -jar com/mindprod/brokenlinks/brokenlinks.jar {put any parms here}

adjusting as necessary to account for where the jar file is.

----

Rebuilding:

The zip already contains the necessary jar files, so unless you modify
the program, there is no need to recompile the source or rebuild the jar.
Configure.java basedir="E:/" in rebuild.xml to the drive where your files are.
Use ANT and rebuild.xml, not build.xml, to recompile and recreate the jar.

----

Use:

Brokenlinks is a tool to help you find and track broken links on your
website, namely URLs that no longer point to anything useful.  It is a
back end to the Xenu Link Sleuth broken link detector that compensates for
Xenu’s weakness of overwhelming you with reports of links that are not
really broken.
Brokenlinks retests ostensibly broken links and maintains a database of
link integrity history.  It partly compensates for various bugs and
deficiencies in Xenu.
Brokenlinks automatically repairs links that have been redirected,
correcting your HTML to point to the new URL.
BrokenLinks typically discovers that only 1% of the links Xenu reports as
broken actually need to be repaired.  99% of them are just down
temporarily or fail Xenu's quick probe, but pass BrokenLink's more patient
test that more accurately simulates what a real browser does.
TidyURLs cleans up all the hrefs= and src= on your website.  This help
ReplaceURLs work properly.
ReplaceURLs patches URLs in your local website files to the new redirected
values that BrokenLinks finds.
The Brokenlinks manual at:
http://mindprod.com/application/brokenlinks.manual.html
explains in more detail what it is for and how to use it.
I M P O R T A N T !
This version of BrokenLinks only works with a special version of Xenu
that exports numeric status codes.
You can get it from either:
http://mindprod.com/zips/xenubeta20121111.zip
or
http://home.snafu.de/tilman/tmp/xenubeta.zip
Why the scissors logo?  It is a temporary logo until I can find a decent
broken link icon.  It represents a link being cut/broken.


----

Version History:

 1.0 2008-07-21 initial version.

 1.1 2008-08-01 export all HTML in one lump, complete with headers and footers.

 1.2 2008-08-08 first version released to the public. No forgiveness on broken local links.
                and text version of summary report.

 1.3 2008-10-29 handle empty URLs.

 1.4 2008-11-29 add suspectForgivenessDays

 1.5 2009-02-14 handle null status, properly delay reporting new broken links.

 1.6 2009-02-20 refactor to use new HTTP library

 1.7 2010-09-10 handle Xenu's new mailto checking.

 1.8 2010-11-14 primitive permanent redirect handling.

 1.9 2010-11-17 export of redirects working. Not yet polished. Add ReplaceURLs.

 2.0 2010-12-30 export permanent and temporary redirects separately.

 2.1 2010-12-31 correct bug in merging original and redirected urls.

 2.2 2011-01-16 and TidyURLs utility to clean up all the hrefs on your website.

 2.3 2011-02-08 handle https: redirects and faster https: link checking.

 2.4 2012-02-26 faster probing using 30 threads. Must delete history.bin to use new version.

 2.5 2012-02-28 faster probing of redirects with 30 threads. No longer need to sort/align results separately.

 2.6 2012-06-02 simpler configuration. Now uses fixed file names in the current directory.
                Limit number of froms saved for speed/memory.
                Don't put ignored items in list.
                Faster lookup of status kind.

 2.7 2012-11-22 uses special version of Xenu that includes numeric status.
                Faster. easier to configure new status codes.

 2.8 2012-11-28 faster handling of local links.

 2.9 2012-12-02 optional leave.csv file.

 3.0 2013-01-20 ensure responsecodes.ser is accessible. Clarify error messages.

 3.1 2017-03-15 try both with and without SNI on fail

-30-