source: Validate External Links/Run validate_external_links.command@ 1135

Last change on this file since 1135 was 1135, checked in by iritscen, 4 years ago

Added option to not validate archive.org URLs, as those are unlikely to go bad, and we have an increasing number of them. Val now reports trivial redirect settings in Config section.

  • Property svn:executable set to *
File size: 2.2 KB
RevLine 
[1064]1#!/bin/bash
2
3# Runs the Validate External Links script
[1135]4# Arguments: --help, --links URL, --exceptions URL, --output DIR, --record-ok-links, --show-added-slashes, --show-https-upgrades, --show-yt-redirects,
5# --suggest-snapshots, --skip-archive-links, --take-screenshots FILE, --start-url NUM, --end-url NUM, --upload FILE
[1064]6# Recommended rule:
[1135]7# |----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- -----|
[1064]8
9# Set variables for any arguments we might use below
10VALEXTLINKS="/path/to/Validate External Links/validate_external_links.sh"
11LINKS_LOCAL="file:///path/to/Validate External Links/Sample files/extlinks.csv"
12LINKS_ONLINE="http://wiki.oni2.net/w/extlinks.csv"
13EXCEPT_LOCAL="file:///path/to/Validate External Links/exceptions.txt"
[1066]14EXCEPT_ONLINE="http://iritscen.oni2.net/val/exceptions.txt"
[1064]15REPORT_DIR="/path/to/ValExtLinks reports"
16UPLOAD_INFO="/path/to/Validate External Links/sftp_login.txt"
[1118]17CHROME="/Applications/Google Chrome.app/Contents/MacOS/Google Chrome"
[1064]18
19
[1118]20# Run with end URL, and record OK codes
[1070]21#bash "$VALEXTLINKS" --links "$LINKS_ONLINE" --exceptions "$EXCEPT_ONLINE" --output "$REPORT_DIR" --record-ok-links --suggest-snapshots --end-url 70
[1064]22
[1118]23# Run with start/end URLs, and record OK codes
[1135]24#bash "$VALEXTLINKS" --links "$LINKS_ONLINE" --exceptions "$EXCEPT_ONLINE" --output "$REPORT_DIR" --record-ok-links --suggest-snapshots --start-url 210 --end-url 235
[1118]25
[1070]26# Run with local extlinks and exceptions, start/end URLs, and record OK codes
[1135]27#bash "$VALEXTLINKS" --links "$LINKS_LOCAL" --exceptions "$EXCEPT_LOCAL" --output "$REPORT_DIR" --record-ok-links --suggest-snapshots --skip-archive-links --start-url 1 --end-url 25
[1064]28
[1070]29# Run with unfinished screenshot feature
30#bash "$VALEXTLINKS" --links "$LINKS_ONLINE" --exceptions "$EXCEPT_ONLINE" --output "$REPORT_DIR" --record-ok-links --take-screenshots "$CHROME"
31
[1118]32# Normal run with no upload
33#bash "$VALEXTLINKS" --links "$LINKS_ONLINE" --exceptions "$EXCEPT_ONLINE" --output "$REPORT_DIR" --suggest-snapshots
34
35# Normal run
[1135]36bash "$VALEXTLINKS" --links "$LINKS_ONLINE" --exceptions "$EXCEPT_ONLINE" --output "$REPORT_DIR" --suggest-snapshots --skip-archive-links --upload "$UPLOAD_INFO"
Note: See TracBrowser for help on using the repository browser.