https://phyc-wiki.chem.oregonstate.edu/api.php?action=feedcontributions&feedformat=atom&user=TjmustardPHYC Wiki - User contributions [en]2026-04-14T12:17:28ZUser contributionsMediaWiki 1.34.0https://phyc-wiki.chem.oregonstate.edu/index.php?title=Public:Public_Test&diff=132Public:Public Test2014-05-21T22:34:17Z<p>Tjmustard: Created page with "This is a public test page. 5/21/14"</p>
<hr />
<div>This is a public test page. 5/21/14</div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=Main_Page&diff=129Main Page2014-05-21T22:33:55Z<p>Tjmustard: /* Public Resources */</p>
<hr />
<div><br />
===General===<br />
----<br />
* [[Public:Group_News|Group News]]<br />
<br />
* [[About PHYC]]<br />
<br />
* [[General Research in the PHYC Group]]<br />
<br />
* [[Public:Collaborators|Collabrators]]<br />
<br />
* [http://phyc.chem.oregonstate.edu/publications Publications]<br />
<br />
===Software Related===<br />
----<br />
* [[Apple Related]]<br />
<br />
* [[Linux Related]]<br />
<br />
* [[Text Editors]]<br />
<br />
* [[Computational Software Related]]<br />
<br />
* [[Computational Software Manuals]]<br />
<br />
* [[Ad Hoc Script Collection]]<br />
<br />
* [[Strange Error Messages]]<br />
<br />
<br />
===Resources===<br />
----<br />
* [[Woodward]]<br />
<br />
* [[Fermi]]<br />
<br />
<br />
===Programming===<br />
----<br />
<br />
* [[BASH]]<br />
<br />
* [[Python]]<br />
<br />
* [[C++]]<br />
<br />
<br />
===Links===<br />
----<br />
* [[Chemistry Journals]]<br />
<br />
* [[Computational Chemistry]]<br />
<br />
* [[Organic Chemistry News, Highlights and Blogs]]<br />
<br />
* [[Other Links]]<br />
<br />
===Public Resources===<br />
----<br />
[[Publics:Public Test Page]]<br />
[[Public:Public_Test|Public Test]]<br />
<br />
== Getting started ==<br />
* [//www.mediawiki.org/wiki/Manual:Configuration_settings Configuration settings list]<br />
* [//www.mediawiki.org/wiki/Manual:FAQ MediaWiki FAQ]<br />
* [https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]<br />
* [//www.mediawiki.org/wiki/Localisation#Translation_resources Localise MediaWiki for your language]<br />
<br />
Consult the [//meta.wikimedia.org/wiki/Help:Contents User's Guide] for information on using the wiki software.</div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=SED&diff=113SED2014-05-13T17:46:22Z<p>Tjmustard: </p>
<hr />
<div>==General Use==<br />
SED can be used to:<br />
# replace a sting with a new string<br />
# remove unwanted characters<br />
<br />
==Handy One Liners==<br />
<pre><br />
;HANDY ONE-LINERS FOR SED (Unix stream editor) Oct. 29, 1997 <br />
:compiled by Eric Pement <epement@jpusa.chi.il.us> version 4.3 <br />
:Latest version of this file is always at <http://www.wollery.demon.co.uk><br />
<br />
<br />
==FILE SPACING:==<br />
<br />
===double space a file===<br />
sed G<br />
<br />
===triple space a file===<br />
sed 'G;G'<br />
<br />
===undo double-spacing (assumes even-numbered lines are always blank)===<br />
sed 'n;d'<br />
<br />
<br />
==NUMBERING:==<br />
<br />
===number each line of a file (simple left alignment). Using a tab (see note on '\t' at end of file) instead of space will preserve margins. ===<br />
sed = filename | sed 'N;s/\n/\t/'<br />
<br />
===number each line of a file (number on left, right-aligned) ===<br />
sed = filename | sed 'N; s/^/ /; s/ *\(.\{6,\}\)\n/\1 /'<br />
<br />
===number each line of file, but only print numbers if line is not blank ===<br />
sed '/./=' filename | sed '/./N; s/\n/ /'<br />
<br />
===count lines (emulates "wc -l") ===<br />
sed -n '$='<br />
<br />
<br />
==TEXT CONVERSION AND SUBSTITUTION:==<br />
<br />
===IN UNIX ENVIRONMENT: convert DOS newlines (CR/LF) to Unix format ===<br />
sed 's/.$//'<br />
<br />
===IN DOS ENVIRONMENT: convert Unix newlines (LF) to DOS format ===<br />
sed 's/$//' # method 1 <br />
sed -n p # method 2<br />
<br />
===delete leading whitespace (spaces, tabs) from front of each line aligns all text flush left ===<br />
sed 's/^[ \t]*//' # see note on '\t' at end of file<br />
<br />
===delete trailing whitespace (spaces, tabs) from end of each line=== <br />
sed 's/[ \t]*$//' # see note on '\t' at end of file<br />
<br />
===delete BOTH leading and trailing whitespace from each line=== <br />
sed 's/^[ \t]*//;s/[ \t]*$//'<br />
<br />
===insert 5 blank spaces at beginning of each line (make page offset) ===<br />
sed 's/^/ /'<br />
<br />
===align all text flush right on a 79-column width=== <br />
sed -e :a -e 's/^.\{1,78\}$/ &/;ta' # set at 78 plus 1 space<br />
<br />
===center all text in the middle of 79-column width. In method 1, spaces at the beginning of the line are significant, and trailing spaces are appended at the end of the line. In method 2, spaces at the beginning of the line are discarded in centering the line, and no trailing spaces appear at the end of lines. ===<br />
sed -e :a -e 's/^.\{1,77\}$/ & /;ta' # method 1 <br />
sed -e :a -e 's/^.\{1,77\}$/ &/;ta' -e 's/\( *\)\1/\1/' # method 2<br />
<br />
===substitute (find & replace) "foo" with "bar" on each line ===<br />
sed 's/foo/bar/' # replaces only 1st instance in a line <br />
sed 's/foo/bar/4' # replaces only 4th instance in a line <br />
sed 's/foo/bar/g' # replaces ALL instances in a line<br />
<br />
===substitute "foo" with "bar" ONLY for lines which contain "baz" ===<br />
sed '/baz/s/foo/bar/g'<br />
<br />
===substitute "foo" with "bar" EXCEPT for lines which contain "baz" ===<br />
sed '/baz/!s/foo/bar/g'<br />
<br />
===reverse order of lines (emulates "tac") ===<br />
sed '1!G;h;$!d'<br />
<br />
===reverse each character on the line (emulates "rev") ===<br />
sed '/\n/!G;s/\(.\)\(.*\n\)/&\2\1/;//D;s/.//'<br />
<br />
===join pairs of lines side-by-side (like "paste") ===<br />
sed 'N;s/\n/ /'<br />
<br />
<br />
==SELECTIVE PRINTING OF CERTAIN LINES:==<br />
<br />
===print first 10 lines of file (emulates behavior of "head") ===<br />
sed 10q<br />
<br />
===print first line of file (emulates "head -1") ===<br />
sed q<br />
<br />
===print last 10 lines of file (emulates "tail") ===<br />
sed -e :a -e '$q;N;11,$D;ba'<br />
<br />
===print last line of file (emulates "tail -1") ===<br />
sed '$!d'<br />
<br />
===print only lines which match regular expression (emulates "grep") ===<br />
sed -n '/regexp/p' # method 1 <br />
sed '/regexp/!d' # method 2<br />
<br />
===print only lines which do NOT match regexp (emulates "grep -v") ===<br />
sed -n '/regexp/!p' # method 1, corresponds to above <br />
sed '/regexp/d' # method 2, simpler syntax<br />
<br />
===print 1 line of context before and after regexp, with line number indicating where the regexp occurred (similar to "grep -A1 -B1") ===<br />
sed -n -e '/regexp/{=;x;1!p;g;$!N;p;D;}' -e h<br />
<br />
===grep for AAA and BBB and CCC (in any order) ===<br />
sed '/AAA/!d; /BBB/!d; /CCC/!d'<br />
<br />
===grep for AAA or BBB or CCC (emulates "egrep") ===<br />
sed -e '/AAA/b' -e '/BBB/b' -e '/CCC/b' -e d<br />
<br />
===print only lines of 65 characters or longer ===<br />
sed -n '/^.\{65\}/p'<br />
<br />
===print only lines of less than 65 characters ===<br />
sed -n '/^.\{65\}/!p' # method 1, corresponds to above <br />
sed '/^.\{65\}/d' # method 2, simpler syntax<br />
<br />
===print section of file from regular expression to end of file ===<br />
sed -n '/regexp/,$p'<br />
<br />
===print section of file based on line numbers (lines 8-12, inclusive) ===<br />
sed -n '8,12p' # method 1 <br />
sed '8,12!d' # method 2<br />
<br />
===print line number 52 ===<br />
sed -n '52p' # method 1 <br />
sed '52!d' # method 2 <br />
sed '52q;d' # method 3, efficient on large files<br />
<br />
===print section of file between two regular expressions (inclusive) ===<br />
sed -n '/Iowa/,/Montana/p' # case sensitive<br />
<br />
<br />
==SELECTIVE DELETION OF CERTAIN LINES:==<br />
<br />
===print all of file EXCEPT section between 2 regular expressions ===<br />
sed '/Iowa/,/Montana/d'<br />
<br />
===delete duplicate lines from a sorted file (emulates "uniq"). First line in a set of duplicate lines is kept, the rest are deleted ===<br />
sed '$!N; /^\(.*\)\n\1$/!P; D'<br />
<br />
===delete ALL blank lines from a file (same as "grep '.' ") ===<br />
sed '/^$/d'<br />
<br />
===delete all CONSECUTIVE blank lines from file except the first; also deletes all blank lines from top and end of file (emulates "cat -s") ===<br />
sed '/./,/^$/!d' # method 1, allows 0 blanks at top, 1 at EOF <br />
sed '/^$/N;/\n$/D' # method 2, allows 1 blank at top, 0 at EOF<br />
<br />
===delete all CONSECUTIVE blank lines from file except the first 2:=== <br />
sed '/^$/N;/\n$/N;//D'<br />
<br />
===delete all leading blank lines at top of file=== <br />
sed '/./,$!d'<br />
<br />
===delete all trailing blank lines at end of file=== <br />
sed -e :a -e '/^\n*$/N;/\n$/ba'<br />
<br />
<br />
==SPECIAL APPLICATIONS:==<br />
<br />
===remove nroff overstrikes (char, backspace) from man pages=== <br />
sed "s/.`echo \\\b`//g" # double quotes required for Unix environment <br />
sed 's/.\x08//g' # hex expression for GNU sed (octal is "\010")<br />
<br />
===get Usenet/e-mail message header=== <br />
sed '/^$/q' # deletes everything after first blank line<br />
<br />
===get Usenet/e-mail message body=== <br />
sed '1,/^$/d' # deletes everything up to first blank line<br />
<br />
===get Subject header, but remove initial "Subject: " portion ===<br />
sed '/^Subject: */!d; s///;q'<br />
<br />
===get return address header ===<br />
sed '/^Reply-To:/q; /^From:/h; /./d;g;q'<br />
<br />
===parse out the address proper. Pulls out the e-mail address by itself from the 1-line return address header (see preceding script) ===<br />
sed 's/ *(.*)//; s/>.*//; s/.*[:<] *//'<br />
<br />
===add a leading angle bracket and space to each line (quote a message)=== <br />
sed 's/^/> /<br />
<br />
===delete leading angle bracket & space from each line (unquote a message)=== <br />
sed 's/^> //'<br />
<br />
===remove most HTML tags (accommodates multiple-line tags)=== <br />
sed -e :a -e 's/<[^<]*>/ /g;/</{N;s/\n/ /;ba;}'<br />
<br />
===extract multi-part uuencoded binaries, removing extraneous header info, so that only the uuencoded portion remains. Files passed to sed must be passed in the proper order. Version 1 can be entered from the command line; version 2 can be made into an executable Unix shell script. (Modified from a script by Rahul Dhesi.) ===<br />
sed '/^end/,/^begin/d' file1 file2 ... fileX | uudecode # vers. 1 <br />
sed '/^end/,/^begin/d' $* | uudecode # vers. 2<br />
<br />
===zip up each .TXT file individually, deleting the source file and setting the name of each .ZIP file to the basename of the .TXT file (under DOS: the "dir /b" switch returns bare filenames in all caps).=== <br />
echo @echo off >zipup.bat <br />
dir /b *.txt | sed "s/^\(.*\)\.TXT/pkzip -mo \1 \1.TXT/" >>zipup.bat<br />
<br />
<br />
==TYPICAL USE:==<br />
;Sed takes one or more editing commands and applies all of them, in sequence, to each line of input. After all the commands have been applied to the first input line, that line is output and a second input line is taken for processing, and the cycle repeats. The preceding examples assume that input comes from the standard input device (i.e, the console, normally this will be piped input). One or more filenames can be appended to the command line if the input does not come from stdin. Output is sent to stdout (the screen). Thus:<br />
<br />
cat filename | sed '10q' # uses piped input <br />
sed '10q' filename # same effect, avoids a useless "cat" <br />
sed '10q' filename > newfile # redirects output to disk<br />
<br />
;For additional syntax instructions, including the way to apply editing commands from a disk file instead of the command line, consult "sed & awk, 2nd Edition," by Dale Dougherty and Arnold Robbins (O'Reilly, 1997; http://www.ora.com), "UNIX Text Processing," by Dale Dougherty and Tim O'Reilly (Hayden Books, 1987) or the tutorials by Mike Arst distributed in U-SEDIT2.ZIP (many sites). To fully exploit the power of sed, one must understand "regular expressions." For this, see "Mastering Regular Expressions" by Jeffrey Friedl (O'Reilly, 1997). The manual ("man") pages on Unix systems may be helpful (try "man sed", "man regexp", or the subsection on regular expressions in "man ed"), but man pages are notoriously difficult. They are not written to teach sed use or regexps to first-time users, but as a reference text for those already acquainted with these tools. <br />
<br />
<br />
==QUOTING SYNTAX:==<br />
;The preceding examples use single quotes ('...') instead of double quotes ("...") to enclose editing commands, since sed is typically used on a Unix platform. Single quotes prevent the Unix shell from intrepreting the dollar sign ($) and backquotes (`...`), which are expanded by the shell if they are enclosed in double quotes. Users of the "csh" shell and derivatives will also need to quote the exclamation mark (!) with the backslash (i.e., \!) to properly run the examples listed above, even within single quotes. Versions of sed written for DOS invariably require double quotes ("...") instead of single quotes to enclose editing commands. <br />
<br />
;USE OF '\t' IN SED SCRIPTS: For clarity in documentation, we have used the expression '\t' to indicate a tab character (0x09) in the scripts. However, most versions of sed do not recognize the '\t' abbreviation, so when typing these scripts from the command line, you should press the TAB key instead. '\t' is supported as a regular expression metacharacter in awk, perl, and in a few implementations of sed. <br />
<br />
<br />
==VERSIONS OF SED:==<br />
;Versions of sed do differ, and some slight syntax variation is to be expected. In particular, most do not support the use of labels (:name) or branch instructions (b,t) within editing commands, except at the end of those commands. We have used the syntax which will be portable to most users of sed, even though the popular GNU versions of sed allow a more succinct syntax. When the reader sees a fairly long command such as this: <br />
<br />
sed -e '/AAA/b' -e '/BBB/b' -e '/CCC/b' -e d<br />
<br />
;it is heartening to know that GNU sed will let you reduce it to:<br />
<br />
sed '/AAA/b;/BBB/b;/CCC/b;d'<br />
<br />
;In addition, remember that while many versions of sed accept a command like "/one/ s/RE1/RE2/", some do NOT allow "/one/! s/RE1/RE2/", which contains space before the 's'. Omit the space when typing the command.<br />
<br />
<br />
==OPTIMIZING FOR SPEED:==<br />
;If execution speed needs to be increased (due to large input files or slow processors or hard disks), substitution will be executed more quickly if the "find" expression is specified before giving the "s/.../.../" instruction. Thus:<br />
<br />
sed 's/foo/bar/g' filename # standard replace command <br />
sed '/foo/ s/foo/bar/g' filename # executes more quickly <br />
sed '/foo/ s//bar/g' filename # shorthand sed syntax<br />
<br />
;On line selection or deletion in which you only need to output lines from the first part of the file, a "quit" command (q) in the script will drastically reduce processing time for large files. Thus:<br />
<br />
sed -n '45,50p' filename # print line nos. 45-50 of a file <br />
sed -n '51q;45,50p' filename # same, but executes much faster<br />
<br />
;If you have any additional scripts to contribute or if you find errors in this document, please send e-mail to the compiler. Indicate the version of sed you used, the operating system it was compiled for, and the nature of the problem. Various scripts in this file were written or contributed by:<br />
<br />
Al Aab <af137@freenet.toronto.on.ca> # "seders" list moderator <br />
Dale Dougherty <dale@songline.com> # author of "sed & awk" <br />
Carlos Duarte <cdua@algos.inesc.pt> # author of "do it with sed" <br />
Eric Pement <epement@jpusa.chi.il.us> # author of this document <br />
S.G.Ravenhall < S.G.Ravenhall@open.ac.uk> # great de-html script <br />
Greg Ubben <gsu@romulus.ncsc.mil> # many contributions & much help<br />
<br />
==Additional SED Commands==<br />
===Lowercase to Upercase===<br />
sed ’s/./\u&/g’<br />
</pre></div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=SED&diff=111SED2014-05-13T17:45:30Z<p>Tjmustard: </p>
<hr />
<div>==General Use==<br />
<br />
<br />
==Handy One Liners==<br />
<pre><br />
;HANDY ONE-LINERS FOR SED (Unix stream editor) Oct. 29, 1997 <br />
:compiled by Eric Pement <epement@jpusa.chi.il.us> version 4.3 <br />
:Latest version of this file is always at <http://www.wollery.demon.co.uk><br />
<br />
<br />
==FILE SPACING:==<br />
<br />
===double space a file===<br />
sed G<br />
<br />
===triple space a file===<br />
sed 'G;G'<br />
<br />
===undo double-spacing (assumes even-numbered lines are always blank)===<br />
sed 'n;d'<br />
<br />
<br />
==NUMBERING:==<br />
<br />
===number each line of a file (simple left alignment). Using a tab (see note on '\t' at end of file) instead of space will preserve margins. ===<br />
sed = filename | sed 'N;s/\n/\t/'<br />
<br />
===number each line of a file (number on left, right-aligned) ===<br />
sed = filename | sed 'N; s/^/ /; s/ *\(.\{6,\}\)\n/\1 /'<br />
<br />
===number each line of file, but only print numbers if line is not blank ===<br />
sed '/./=' filename | sed '/./N; s/\n/ /'<br />
<br />
===count lines (emulates "wc -l") ===<br />
sed -n '$='<br />
<br />
<br />
==TEXT CONVERSION AND SUBSTITUTION:==<br />
<br />
===IN UNIX ENVIRONMENT: convert DOS newlines (CR/LF) to Unix format ===<br />
sed 's/.$//'<br />
<br />
===IN DOS ENVIRONMENT: convert Unix newlines (LF) to DOS format ===<br />
sed 's/$//' # method 1 <br />
sed -n p # method 2<br />
<br />
===delete leading whitespace (spaces, tabs) from front of each line aligns all text flush left ===<br />
sed 's/^[ \t]*//' # see note on '\t' at end of file<br />
<br />
===delete trailing whitespace (spaces, tabs) from end of each line=== <br />
sed 's/[ \t]*$//' # see note on '\t' at end of file<br />
<br />
===delete BOTH leading and trailing whitespace from each line=== <br />
sed 's/^[ \t]*//;s/[ \t]*$//'<br />
<br />
===insert 5 blank spaces at beginning of each line (make page offset) ===<br />
sed 's/^/ /'<br />
<br />
===align all text flush right on a 79-column width=== <br />
sed -e :a -e 's/^.\{1,78\}$/ &/;ta' # set at 78 plus 1 space<br />
<br />
===center all text in the middle of 79-column width. In method 1, spaces at the beginning of the line are significant, and trailing spaces are appended at the end of the line. In method 2, spaces at the beginning of the line are discarded in centering the line, and no trailing spaces appear at the end of lines. ===<br />
sed -e :a -e 's/^.\{1,77\}$/ & /;ta' # method 1 <br />
sed -e :a -e 's/^.\{1,77\}$/ &/;ta' -e 's/\( *\)\1/\1/' # method 2<br />
<br />
===substitute (find & replace) "foo" with "bar" on each line ===<br />
sed 's/foo/bar/' # replaces only 1st instance in a line <br />
sed 's/foo/bar/4' # replaces only 4th instance in a line <br />
sed 's/foo/bar/g' # replaces ALL instances in a line<br />
<br />
===substitute "foo" with "bar" ONLY for lines which contain "baz" ===<br />
sed '/baz/s/foo/bar/g'<br />
<br />
===substitute "foo" with "bar" EXCEPT for lines which contain "baz" ===<br />
sed '/baz/!s/foo/bar/g'<br />
<br />
===reverse order of lines (emulates "tac") ===<br />
sed '1!G;h;$!d'<br />
<br />
===reverse each character on the line (emulates "rev") ===<br />
sed '/\n/!G;s/\(.\)\(.*\n\)/&\2\1/;//D;s/.//'<br />
<br />
===join pairs of lines side-by-side (like "paste") ===<br />
sed 'N;s/\n/ /'<br />
<br />
<br />
==SELECTIVE PRINTING OF CERTAIN LINES:==<br />
<br />
===print first 10 lines of file (emulates behavior of "head") ===<br />
sed 10q<br />
<br />
===print first line of file (emulates "head -1") ===<br />
sed q<br />
<br />
===print last 10 lines of file (emulates "tail") ===<br />
sed -e :a -e '$q;N;11,$D;ba'<br />
<br />
===print last line of file (emulates "tail -1") ===<br />
sed '$!d'<br />
<br />
===print only lines which match regular expression (emulates "grep") ===<br />
sed -n '/regexp/p' # method 1 <br />
sed '/regexp/!d' # method 2<br />
<br />
===print only lines which do NOT match regexp (emulates "grep -v") ===<br />
sed -n '/regexp/!p' # method 1, corresponds to above <br />
sed '/regexp/d' # method 2, simpler syntax<br />
<br />
===print 1 line of context before and after regexp, with line number indicating where the regexp occurred (similar to "grep -A1 -B1") ===<br />
sed -n -e '/regexp/{=;x;1!p;g;$!N;p;D;}' -e h<br />
<br />
===grep for AAA and BBB and CCC (in any order) ===<br />
sed '/AAA/!d; /BBB/!d; /CCC/!d'<br />
<br />
===grep for AAA or BBB or CCC (emulates "egrep") ===<br />
sed -e '/AAA/b' -e '/BBB/b' -e '/CCC/b' -e d<br />
<br />
===print only lines of 65 characters or longer ===<br />
sed -n '/^.\{65\}/p'<br />
<br />
===print only lines of less than 65 characters ===<br />
sed -n '/^.\{65\}/!p' # method 1, corresponds to above <br />
sed '/^.\{65\}/d' # method 2, simpler syntax<br />
<br />
===print section of file from regular expression to end of file ===<br />
sed -n '/regexp/,$p'<br />
<br />
===print section of file based on line numbers (lines 8-12, inclusive) ===<br />
sed -n '8,12p' # method 1 <br />
sed '8,12!d' # method 2<br />
<br />
===print line number 52 ===<br />
sed -n '52p' # method 1 <br />
sed '52!d' # method 2 <br />
sed '52q;d' # method 3, efficient on large files<br />
<br />
===print section of file between two regular expressions (inclusive) ===<br />
sed -n '/Iowa/,/Montana/p' # case sensitive<br />
<br />
<br />
==SELECTIVE DELETION OF CERTAIN LINES:==<br />
<br />
===print all of file EXCEPT section between 2 regular expressions ===<br />
sed '/Iowa/,/Montana/d'<br />
<br />
===delete duplicate lines from a sorted file (emulates "uniq"). First line in a set of duplicate lines is kept, the rest are deleted ===<br />
sed '$!N; /^\(.*\)\n\1$/!P; D'<br />
<br />
===delete ALL blank lines from a file (same as "grep '.' ") ===<br />
sed '/^$/d'<br />
<br />
===delete all CONSECUTIVE blank lines from file except the first; also deletes all blank lines from top and end of file (emulates "cat -s") ===<br />
sed '/./,/^$/!d' # method 1, allows 0 blanks at top, 1 at EOF <br />
sed '/^$/N;/\n$/D' # method 2, allows 1 blank at top, 0 at EOF<br />
<br />
===delete all CONSECUTIVE blank lines from file except the first 2:=== <br />
sed '/^$/N;/\n$/N;//D'<br />
<br />
===delete all leading blank lines at top of file=== <br />
sed '/./,$!d'<br />
<br />
===delete all trailing blank lines at end of file=== <br />
sed -e :a -e '/^\n*$/N;/\n$/ba'<br />
<br />
<br />
==SPECIAL APPLICATIONS:==<br />
<br />
===remove nroff overstrikes (char, backspace) from man pages=== <br />
sed "s/.`echo \\\b`//g" # double quotes required for Unix environment <br />
sed 's/.\x08//g' # hex expression for GNU sed (octal is "\010")<br />
<br />
===get Usenet/e-mail message header=== <br />
sed '/^$/q' # deletes everything after first blank line<br />
<br />
===get Usenet/e-mail message body=== <br />
sed '1,/^$/d' # deletes everything up to first blank line<br />
<br />
===get Subject header, but remove initial "Subject: " portion ===<br />
sed '/^Subject: */!d; s///;q'<br />
<br />
===get return address header ===<br />
sed '/^Reply-To:/q; /^From:/h; /./d;g;q'<br />
<br />
===parse out the address proper. Pulls out the e-mail address by itself from the 1-line return address header (see preceding script) ===<br />
sed 's/ *(.*)//; s/>.*//; s/.*[:<] *//'<br />
<br />
===add a leading angle bracket and space to each line (quote a message)=== <br />
sed 's/^/> /<br />
<br />
===delete leading angle bracket & space from each line (unquote a message)=== <br />
sed 's/^> //'<br />
<br />
===remove most HTML tags (accommodates multiple-line tags)=== <br />
sed -e :a -e 's/<[^<]*>/ /g;/</{N;s/\n/ /;ba;}'<br />
<br />
===extract multi-part uuencoded binaries, removing extraneous header info, so that only the uuencoded portion remains. Files passed to sed must be passed in the proper order. Version 1 can be entered from the command line; version 2 can be made into an executable Unix shell script. (Modified from a script by Rahul Dhesi.) ===<br />
sed '/^end/,/^begin/d' file1 file2 ... fileX | uudecode # vers. 1 <br />
sed '/^end/,/^begin/d' $* | uudecode # vers. 2<br />
<br />
===zip up each .TXT file individually, deleting the source file and setting the name of each .ZIP file to the basename of the .TXT file (under DOS: the "dir /b" switch returns bare filenames in all caps).=== <br />
echo @echo off >zipup.bat <br />
dir /b *.txt | sed "s/^\(.*\)\.TXT/pkzip -mo \1 \1.TXT/" >>zipup.bat<br />
<br />
<br />
==TYPICAL USE:==<br />
;Sed takes one or more editing commands and applies all of them, in sequence, to each line of input. After all the commands have been applied to the first input line, that line is output and a second input line is taken for processing, and the cycle repeats. The preceding examples assume that input comes from the standard input device (i.e, the console, normally this will be piped input). One or more filenames can be appended to the command line if the input does not come from stdin. Output is sent to stdout (the screen). Thus:<br />
<br />
cat filename | sed '10q' # uses piped input <br />
sed '10q' filename # same effect, avoids a useless "cat" <br />
sed '10q' filename > newfile # redirects output to disk<br />
<br />
;For additional syntax instructions, including the way to apply editing commands from a disk file instead of the command line, consult "sed & awk, 2nd Edition," by Dale Dougherty and Arnold Robbins (O'Reilly, 1997; http://www.ora.com), "UNIX Text Processing," by Dale Dougherty and Tim O'Reilly (Hayden Books, 1987) or the tutorials by Mike Arst distributed in U-SEDIT2.ZIP (many sites). To fully exploit the power of sed, one must understand "regular expressions." For this, see "Mastering Regular Expressions" by Jeffrey Friedl (O'Reilly, 1997). The manual ("man") pages on Unix systems may be helpful (try "man sed", "man regexp", or the subsection on regular expressions in "man ed"), but man pages are notoriously difficult. They are not written to teach sed use or regexps to first-time users, but as a reference text for those already acquainted with these tools. <br />
<br />
<br />
==QUOTING SYNTAX:==<br />
;The preceding examples use single quotes ('...') instead of double quotes ("...") to enclose editing commands, since sed is typically used on a Unix platform. Single quotes prevent the Unix shell from intrepreting the dollar sign ($) and backquotes (`...`), which are expanded by the shell if they are enclosed in double quotes. Users of the "csh" shell and derivatives will also need to quote the exclamation mark (!) with the backslash (i.e., \!) to properly run the examples listed above, even within single quotes. Versions of sed written for DOS invariably require double quotes ("...") instead of single quotes to enclose editing commands. <br />
<br />
;USE OF '\t' IN SED SCRIPTS: For clarity in documentation, we have used the expression '\t' to indicate a tab character (0x09) in the scripts. However, most versions of sed do not recognize the '\t' abbreviation, so when typing these scripts from the command line, you should press the TAB key instead. '\t' is supported as a regular expression metacharacter in awk, perl, and in a few implementations of sed. <br />
<br />
<br />
==VERSIONS OF SED:==<br />
;Versions of sed do differ, and some slight syntax variation is to be expected. In particular, most do not support the use of labels (:name) or branch instructions (b,t) within editing commands, except at the end of those commands. We have used the syntax which will be portable to most users of sed, even though the popular GNU versions of sed allow a more succinct syntax. When the reader sees a fairly long command such as this: <br />
<br />
sed -e '/AAA/b' -e '/BBB/b' -e '/CCC/b' -e d<br />
<br />
;it is heartening to know that GNU sed will let you reduce it to:<br />
<br />
sed '/AAA/b;/BBB/b;/CCC/b;d'<br />
<br />
;In addition, remember that while many versions of sed accept a command like "/one/ s/RE1/RE2/", some do NOT allow "/one/! s/RE1/RE2/", which contains space before the 's'. Omit the space when typing the command.<br />
<br />
<br />
==OPTIMIZING FOR SPEED:==<br />
;If execution speed needs to be increased (due to large input files or slow processors or hard disks), substitution will be executed more quickly if the "find" expression is specified before giving the "s/.../.../" instruction. Thus:<br />
<br />
sed 's/foo/bar/g' filename # standard replace command <br />
sed '/foo/ s/foo/bar/g' filename # executes more quickly <br />
sed '/foo/ s//bar/g' filename # shorthand sed syntax<br />
<br />
;On line selection or deletion in which you only need to output lines from the first part of the file, a "quit" command (q) in the script will drastically reduce processing time for large files. Thus:<br />
<br />
sed -n '45,50p' filename # print line nos. 45-50 of a file <br />
sed -n '51q;45,50p' filename # same, but executes much faster<br />
<br />
;If you have any additional scripts to contribute or if you find errors in this document, please send e-mail to the compiler. Indicate the version of sed you used, the operating system it was compiled for, and the nature of the problem. Various scripts in this file were written or contributed by:<br />
<br />
Al Aab <af137@freenet.toronto.on.ca> # "seders" list moderator <br />
Dale Dougherty <dale@songline.com> # author of "sed & awk" <br />
Carlos Duarte <cdua@algos.inesc.pt> # author of "do it with sed" <br />
Eric Pement <epement@jpusa.chi.il.us> # author of this document <br />
S.G.Ravenhall < S.G.Ravenhall@open.ac.uk> # great de-html script <br />
Greg Ubben <gsu@romulus.ncsc.mil> # many contributions & much help<br />
<br />
==Additional SED Commands==<br />
===Lowercase to Upercase===<br />
sed ’s/./\u&/g’<br />
</pre></div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=SED&diff=110SED2014-05-13T17:45:11Z<p>Tjmustard: /* =Handy One Liners */</p>
<hr />
<div>====General Use====<br />
<br />
<br />
====Handy One Liners====<br />
<pre><br />
;HANDY ONE-LINERS FOR SED (Unix stream editor) Oct. 29, 1997 <br />
:compiled by Eric Pement <epement@jpusa.chi.il.us> version 4.3 <br />
:Latest version of this file is always at <http://www.wollery.demon.co.uk><br />
<br />
<br />
==FILE SPACING:==<br />
<br />
===double space a file===<br />
sed G<br />
<br />
===triple space a file===<br />
sed 'G;G'<br />
<br />
===undo double-spacing (assumes even-numbered lines are always blank)===<br />
sed 'n;d'<br />
<br />
<br />
==NUMBERING:==<br />
<br />
===number each line of a file (simple left alignment). Using a tab (see note on '\t' at end of file) instead of space will preserve margins. ===<br />
sed = filename | sed 'N;s/\n/\t/'<br />
<br />
===number each line of a file (number on left, right-aligned) ===<br />
sed = filename | sed 'N; s/^/ /; s/ *\(.\{6,\}\)\n/\1 /'<br />
<br />
===number each line of file, but only print numbers if line is not blank ===<br />
sed '/./=' filename | sed '/./N; s/\n/ /'<br />
<br />
===count lines (emulates "wc -l") ===<br />
sed -n '$='<br />
<br />
<br />
==TEXT CONVERSION AND SUBSTITUTION:==<br />
<br />
===IN UNIX ENVIRONMENT: convert DOS newlines (CR/LF) to Unix format ===<br />
sed 's/.$//'<br />
<br />
===IN DOS ENVIRONMENT: convert Unix newlines (LF) to DOS format ===<br />
sed 's/$//' # method 1 <br />
sed -n p # method 2<br />
<br />
===delete leading whitespace (spaces, tabs) from front of each line aligns all text flush left ===<br />
sed 's/^[ \t]*//' # see note on '\t' at end of file<br />
<br />
===delete trailing whitespace (spaces, tabs) from end of each line=== <br />
sed 's/[ \t]*$//' # see note on '\t' at end of file<br />
<br />
===delete BOTH leading and trailing whitespace from each line=== <br />
sed 's/^[ \t]*//;s/[ \t]*$//'<br />
<br />
===insert 5 blank spaces at beginning of each line (make page offset) ===<br />
sed 's/^/ /'<br />
<br />
===align all text flush right on a 79-column width=== <br />
sed -e :a -e 's/^.\{1,78\}$/ &/;ta' # set at 78 plus 1 space<br />
<br />
===center all text in the middle of 79-column width. In method 1, spaces at the beginning of the line are significant, and trailing spaces are appended at the end of the line. In method 2, spaces at the beginning of the line are discarded in centering the line, and no trailing spaces appear at the end of lines. ===<br />
sed -e :a -e 's/^.\{1,77\}$/ & /;ta' # method 1 <br />
sed -e :a -e 's/^.\{1,77\}$/ &/;ta' -e 's/\( *\)\1/\1/' # method 2<br />
<br />
===substitute (find & replace) "foo" with "bar" on each line ===<br />
sed 's/foo/bar/' # replaces only 1st instance in a line <br />
sed 's/foo/bar/4' # replaces only 4th instance in a line <br />
sed 's/foo/bar/g' # replaces ALL instances in a line<br />
<br />
===substitute "foo" with "bar" ONLY for lines which contain "baz" ===<br />
sed '/baz/s/foo/bar/g'<br />
<br />
===substitute "foo" with "bar" EXCEPT for lines which contain "baz" ===<br />
sed '/baz/!s/foo/bar/g'<br />
<br />
===reverse order of lines (emulates "tac") ===<br />
sed '1!G;h;$!d'<br />
<br />
===reverse each character on the line (emulates "rev") ===<br />
sed '/\n/!G;s/\(.\)\(.*\n\)/&\2\1/;//D;s/.//'<br />
<br />
===join pairs of lines side-by-side (like "paste") ===<br />
sed 'N;s/\n/ /'<br />
<br />
<br />
==SELECTIVE PRINTING OF CERTAIN LINES:==<br />
<br />
===print first 10 lines of file (emulates behavior of "head") ===<br />
sed 10q<br />
<br />
===print first line of file (emulates "head -1") ===<br />
sed q<br />
<br />
===print last 10 lines of file (emulates "tail") ===<br />
sed -e :a -e '$q;N;11,$D;ba'<br />
<br />
===print last line of file (emulates "tail -1") ===<br />
sed '$!d'<br />
<br />
===print only lines which match regular expression (emulates "grep") ===<br />
sed -n '/regexp/p' # method 1 <br />
sed '/regexp/!d' # method 2<br />
<br />
===print only lines which do NOT match regexp (emulates "grep -v") ===<br />
sed -n '/regexp/!p' # method 1, corresponds to above <br />
sed '/regexp/d' # method 2, simpler syntax<br />
<br />
===print 1 line of context before and after regexp, with line number indicating where the regexp occurred (similar to "grep -A1 -B1") ===<br />
sed -n -e '/regexp/{=;x;1!p;g;$!N;p;D;}' -e h<br />
<br />
===grep for AAA and BBB and CCC (in any order) ===<br />
sed '/AAA/!d; /BBB/!d; /CCC/!d'<br />
<br />
===grep for AAA or BBB or CCC (emulates "egrep") ===<br />
sed -e '/AAA/b' -e '/BBB/b' -e '/CCC/b' -e d<br />
<br />
===print only lines of 65 characters or longer ===<br />
sed -n '/^.\{65\}/p'<br />
<br />
===print only lines of less than 65 characters ===<br />
sed -n '/^.\{65\}/!p' # method 1, corresponds to above <br />
sed '/^.\{65\}/d' # method 2, simpler syntax<br />
<br />
===print section of file from regular expression to end of file ===<br />
sed -n '/regexp/,$p'<br />
<br />
===print section of file based on line numbers (lines 8-12, inclusive) ===<br />
sed -n '8,12p' # method 1 <br />
sed '8,12!d' # method 2<br />
<br />
===print line number 52 ===<br />
sed -n '52p' # method 1 <br />
sed '52!d' # method 2 <br />
sed '52q;d' # method 3, efficient on large files<br />
<br />
===print section of file between two regular expressions (inclusive) ===<br />
sed -n '/Iowa/,/Montana/p' # case sensitive<br />
<br />
<br />
==SELECTIVE DELETION OF CERTAIN LINES:==<br />
<br />
===print all of file EXCEPT section between 2 regular expressions ===<br />
sed '/Iowa/,/Montana/d'<br />
<br />
===delete duplicate lines from a sorted file (emulates "uniq"). First line in a set of duplicate lines is kept, the rest are deleted ===<br />
sed '$!N; /^\(.*\)\n\1$/!P; D'<br />
<br />
===delete ALL blank lines from a file (same as "grep '.' ") ===<br />
sed '/^$/d'<br />
<br />
===delete all CONSECUTIVE blank lines from file except the first; also deletes all blank lines from top and end of file (emulates "cat -s") ===<br />
sed '/./,/^$/!d' # method 1, allows 0 blanks at top, 1 at EOF <br />
sed '/^$/N;/\n$/D' # method 2, allows 1 blank at top, 0 at EOF<br />
<br />
===delete all CONSECUTIVE blank lines from file except the first 2:=== <br />
sed '/^$/N;/\n$/N;//D'<br />
<br />
===delete all leading blank lines at top of file=== <br />
sed '/./,$!d'<br />
<br />
===delete all trailing blank lines at end of file=== <br />
sed -e :a -e '/^\n*$/N;/\n$/ba'<br />
<br />
<br />
==SPECIAL APPLICATIONS:==<br />
<br />
===remove nroff overstrikes (char, backspace) from man pages=== <br />
sed "s/.`echo \\\b`//g" # double quotes required for Unix environment <br />
sed 's/.\x08//g' # hex expression for GNU sed (octal is "\010")<br />
<br />
===get Usenet/e-mail message header=== <br />
sed '/^$/q' # deletes everything after first blank line<br />
<br />
===get Usenet/e-mail message body=== <br />
sed '1,/^$/d' # deletes everything up to first blank line<br />
<br />
===get Subject header, but remove initial "Subject: " portion ===<br />
sed '/^Subject: */!d; s///;q'<br />
<br />
===get return address header ===<br />
sed '/^Reply-To:/q; /^From:/h; /./d;g;q'<br />
<br />
===parse out the address proper. Pulls out the e-mail address by itself from the 1-line return address header (see preceding script) ===<br />
sed 's/ *(.*)//; s/>.*//; s/.*[:<] *//'<br />
<br />
===add a leading angle bracket and space to each line (quote a message)=== <br />
sed 's/^/> /<br />
<br />
===delete leading angle bracket & space from each line (unquote a message)=== <br />
sed 's/^> //'<br />
<br />
===remove most HTML tags (accommodates multiple-line tags)=== <br />
sed -e :a -e 's/<[^<]*>/ /g;/</{N;s/\n/ /;ba;}'<br />
<br />
===extract multi-part uuencoded binaries, removing extraneous header info, so that only the uuencoded portion remains. Files passed to sed must be passed in the proper order. Version 1 can be entered from the command line; version 2 can be made into an executable Unix shell script. (Modified from a script by Rahul Dhesi.) ===<br />
sed '/^end/,/^begin/d' file1 file2 ... fileX | uudecode # vers. 1 <br />
sed '/^end/,/^begin/d' $* | uudecode # vers. 2<br />
<br />
===zip up each .TXT file individually, deleting the source file and setting the name of each .ZIP file to the basename of the .TXT file (under DOS: the "dir /b" switch returns bare filenames in all caps).=== <br />
echo @echo off >zipup.bat <br />
dir /b *.txt | sed "s/^\(.*\)\.TXT/pkzip -mo \1 \1.TXT/" >>zipup.bat<br />
<br />
<br />
==TYPICAL USE:==<br />
;Sed takes one or more editing commands and applies all of them, in sequence, to each line of input. After all the commands have been applied to the first input line, that line is output and a second input line is taken for processing, and the cycle repeats. The preceding examples assume that input comes from the standard input device (i.e, the console, normally this will be piped input). One or more filenames can be appended to the command line if the input does not come from stdin. Output is sent to stdout (the screen). Thus:<br />
<br />
cat filename | sed '10q' # uses piped input <br />
sed '10q' filename # same effect, avoids a useless "cat" <br />
sed '10q' filename > newfile # redirects output to disk<br />
<br />
;For additional syntax instructions, including the way to apply editing commands from a disk file instead of the command line, consult "sed & awk, 2nd Edition," by Dale Dougherty and Arnold Robbins (O'Reilly, 1997; http://www.ora.com), "UNIX Text Processing," by Dale Dougherty and Tim O'Reilly (Hayden Books, 1987) or the tutorials by Mike Arst distributed in U-SEDIT2.ZIP (many sites). To fully exploit the power of sed, one must understand "regular expressions." For this, see "Mastering Regular Expressions" by Jeffrey Friedl (O'Reilly, 1997). The manual ("man") pages on Unix systems may be helpful (try "man sed", "man regexp", or the subsection on regular expressions in "man ed"), but man pages are notoriously difficult. They are not written to teach sed use or regexps to first-time users, but as a reference text for those already acquainted with these tools. <br />
<br />
<br />
==QUOTING SYNTAX:==<br />
;The preceding examples use single quotes ('...') instead of double quotes ("...") to enclose editing commands, since sed is typically used on a Unix platform. Single quotes prevent the Unix shell from intrepreting the dollar sign ($) and backquotes (`...`), which are expanded by the shell if they are enclosed in double quotes. Users of the "csh" shell and derivatives will also need to quote the exclamation mark (!) with the backslash (i.e., \!) to properly run the examples listed above, even within single quotes. Versions of sed written for DOS invariably require double quotes ("...") instead of single quotes to enclose editing commands. <br />
<br />
;USE OF '\t' IN SED SCRIPTS: For clarity in documentation, we have used the expression '\t' to indicate a tab character (0x09) in the scripts. However, most versions of sed do not recognize the '\t' abbreviation, so when typing these scripts from the command line, you should press the TAB key instead. '\t' is supported as a regular expression metacharacter in awk, perl, and in a few implementations of sed. <br />
<br />
<br />
==VERSIONS OF SED:==<br />
;Versions of sed do differ, and some slight syntax variation is to be expected. In particular, most do not support the use of labels (:name) or branch instructions (b,t) within editing commands, except at the end of those commands. We have used the syntax which will be portable to most users of sed, even though the popular GNU versions of sed allow a more succinct syntax. When the reader sees a fairly long command such as this: <br />
<br />
sed -e '/AAA/b' -e '/BBB/b' -e '/CCC/b' -e d<br />
<br />
;it is heartening to know that GNU sed will let you reduce it to:<br />
<br />
sed '/AAA/b;/BBB/b;/CCC/b;d'<br />
<br />
;In addition, remember that while many versions of sed accept a command like "/one/ s/RE1/RE2/", some do NOT allow "/one/! s/RE1/RE2/", which contains space before the 's'. Omit the space when typing the command.<br />
<br />
<br />
==OPTIMIZING FOR SPEED:==<br />
;If execution speed needs to be increased (due to large input files or slow processors or hard disks), substitution will be executed more quickly if the "find" expression is specified before giving the "s/.../.../" instruction. Thus:<br />
<br />
sed 's/foo/bar/g' filename # standard replace command <br />
sed '/foo/ s/foo/bar/g' filename # executes more quickly <br />
sed '/foo/ s//bar/g' filename # shorthand sed syntax<br />
<br />
;On line selection or deletion in which you only need to output lines from the first part of the file, a "quit" command (q) in the script will drastically reduce processing time for large files. Thus:<br />
<br />
sed -n '45,50p' filename # print line nos. 45-50 of a file <br />
sed -n '51q;45,50p' filename # same, but executes much faster<br />
<br />
;If you have any additional scripts to contribute or if you find errors in this document, please send e-mail to the compiler. Indicate the version of sed you used, the operating system it was compiled for, and the nature of the problem. Various scripts in this file were written or contributed by:<br />
<br />
Al Aab <af137@freenet.toronto.on.ca> # "seders" list moderator <br />
Dale Dougherty <dale@songline.com> # author of "sed & awk" <br />
Carlos Duarte <cdua@algos.inesc.pt> # author of "do it with sed" <br />
Eric Pement <epement@jpusa.chi.il.us> # author of this document <br />
S.G.Ravenhall < S.G.Ravenhall@open.ac.uk> # great de-html script <br />
Greg Ubben <gsu@romulus.ncsc.mil> # many contributions & much help<br />
<br />
==Additional SED Commands==<br />
===Lowercase to Upercase===<br />
sed ’s/./\u&/g’<br />
</pre></div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=SED&diff=107SED2014-05-13T17:44:16Z<p>Tjmustard: Created page with "====Handy One Liners=== <pre> ;HANDY ONE-LINERS FOR SED (Unix stream editor) Oct. 29, 1997 :compiled by Eric Pement <epement@jpusa.chi.il.us> version 4.3 :Latest version of ..."</p>
<hr />
<div>====Handy One Liners===<br />
<pre><br />
;HANDY ONE-LINERS FOR SED (Unix stream editor) Oct. 29, 1997 <br />
:compiled by Eric Pement <epement@jpusa.chi.il.us> version 4.3 <br />
:Latest version of this file is always at <http://www.wollery.demon.co.uk><br />
<br />
<br />
==FILE SPACING:==<br />
<br />
===double space a file===<br />
sed G<br />
<br />
===triple space a file===<br />
sed 'G;G'<br />
<br />
===undo double-spacing (assumes even-numbered lines are always blank)===<br />
sed 'n;d'<br />
<br />
<br />
==NUMBERING:==<br />
<br />
===number each line of a file (simple left alignment). Using a tab (see note on '\t' at end of file) instead of space will preserve margins. ===<br />
sed = filename | sed 'N;s/\n/\t/'<br />
<br />
===number each line of a file (number on left, right-aligned) ===<br />
sed = filename | sed 'N; s/^/ /; s/ *\(.\{6,\}\)\n/\1 /'<br />
<br />
===number each line of file, but only print numbers if line is not blank ===<br />
sed '/./=' filename | sed '/./N; s/\n/ /'<br />
<br />
===count lines (emulates "wc -l") ===<br />
sed -n '$='<br />
<br />
<br />
==TEXT CONVERSION AND SUBSTITUTION:==<br />
<br />
===IN UNIX ENVIRONMENT: convert DOS newlines (CR/LF) to Unix format ===<br />
sed 's/.$//'<br />
<br />
===IN DOS ENVIRONMENT: convert Unix newlines (LF) to DOS format ===<br />
sed 's/$//' # method 1 <br />
sed -n p # method 2<br />
<br />
===delete leading whitespace (spaces, tabs) from front of each line aligns all text flush left ===<br />
sed 's/^[ \t]*//' # see note on '\t' at end of file<br />
<br />
===delete trailing whitespace (spaces, tabs) from end of each line=== <br />
sed 's/[ \t]*$//' # see note on '\t' at end of file<br />
<br />
===delete BOTH leading and trailing whitespace from each line=== <br />
sed 's/^[ \t]*//;s/[ \t]*$//'<br />
<br />
===insert 5 blank spaces at beginning of each line (make page offset) ===<br />
sed 's/^/ /'<br />
<br />
===align all text flush right on a 79-column width=== <br />
sed -e :a -e 's/^.\{1,78\}$/ &/;ta' # set at 78 plus 1 space<br />
<br />
===center all text in the middle of 79-column width. In method 1, spaces at the beginning of the line are significant, and trailing spaces are appended at the end of the line. In method 2, spaces at the beginning of the line are discarded in centering the line, and no trailing spaces appear at the end of lines. ===<br />
sed -e :a -e 's/^.\{1,77\}$/ & /;ta' # method 1 <br />
sed -e :a -e 's/^.\{1,77\}$/ &/;ta' -e 's/\( *\)\1/\1/' # method 2<br />
<br />
===substitute (find & replace) "foo" with "bar" on each line ===<br />
sed 's/foo/bar/' # replaces only 1st instance in a line <br />
sed 's/foo/bar/4' # replaces only 4th instance in a line <br />
sed 's/foo/bar/g' # replaces ALL instances in a line<br />
<br />
===substitute "foo" with "bar" ONLY for lines which contain "baz" ===<br />
sed '/baz/s/foo/bar/g'<br />
<br />
===substitute "foo" with "bar" EXCEPT for lines which contain "baz" ===<br />
sed '/baz/!s/foo/bar/g'<br />
<br />
===reverse order of lines (emulates "tac") ===<br />
sed '1!G;h;$!d'<br />
<br />
===reverse each character on the line (emulates "rev") ===<br />
sed '/\n/!G;s/\(.\)\(.*\n\)/&\2\1/;//D;s/.//'<br />
<br />
===join pairs of lines side-by-side (like "paste") ===<br />
sed 'N;s/\n/ /'<br />
<br />
<br />
==SELECTIVE PRINTING OF CERTAIN LINES:==<br />
<br />
===print first 10 lines of file (emulates behavior of "head") ===<br />
sed 10q<br />
<br />
===print first line of file (emulates "head -1") ===<br />
sed q<br />
<br />
===print last 10 lines of file (emulates "tail") ===<br />
sed -e :a -e '$q;N;11,$D;ba'<br />
<br />
===print last line of file (emulates "tail -1") ===<br />
sed '$!d'<br />
<br />
===print only lines which match regular expression (emulates "grep") ===<br />
sed -n '/regexp/p' # method 1 <br />
sed '/regexp/!d' # method 2<br />
<br />
===print only lines which do NOT match regexp (emulates "grep -v") ===<br />
sed -n '/regexp/!p' # method 1, corresponds to above <br />
sed '/regexp/d' # method 2, simpler syntax<br />
<br />
===print 1 line of context before and after regexp, with line number indicating where the regexp occurred (similar to "grep -A1 -B1") ===<br />
sed -n -e '/regexp/{=;x;1!p;g;$!N;p;D;}' -e h<br />
<br />
===grep for AAA and BBB and CCC (in any order) ===<br />
sed '/AAA/!d; /BBB/!d; /CCC/!d'<br />
<br />
===grep for AAA or BBB or CCC (emulates "egrep") ===<br />
sed -e '/AAA/b' -e '/BBB/b' -e '/CCC/b' -e d<br />
<br />
===print only lines of 65 characters or longer ===<br />
sed -n '/^.\{65\}/p'<br />
<br />
===print only lines of less than 65 characters ===<br />
sed -n '/^.\{65\}/!p' # method 1, corresponds to above <br />
sed '/^.\{65\}/d' # method 2, simpler syntax<br />
<br />
===print section of file from regular expression to end of file ===<br />
sed -n '/regexp/,$p'<br />
<br />
===print section of file based on line numbers (lines 8-12, inclusive) ===<br />
sed -n '8,12p' # method 1 <br />
sed '8,12!d' # method 2<br />
<br />
===print line number 52 ===<br />
sed -n '52p' # method 1 <br />
sed '52!d' # method 2 <br />
sed '52q;d' # method 3, efficient on large files<br />
<br />
===print section of file between two regular expressions (inclusive) ===<br />
sed -n '/Iowa/,/Montana/p' # case sensitive<br />
<br />
<br />
==SELECTIVE DELETION OF CERTAIN LINES:==<br />
<br />
===print all of file EXCEPT section between 2 regular expressions ===<br />
sed '/Iowa/,/Montana/d'<br />
<br />
===delete duplicate lines from a sorted file (emulates "uniq"). First line in a set of duplicate lines is kept, the rest are deleted ===<br />
sed '$!N; /^\(.*\)\n\1$/!P; D'<br />
<br />
===delete ALL blank lines from a file (same as "grep '.' ") ===<br />
sed '/^$/d'<br />
<br />
===delete all CONSECUTIVE blank lines from file except the first; also deletes all blank lines from top and end of file (emulates "cat -s") ===<br />
sed '/./,/^$/!d' # method 1, allows 0 blanks at top, 1 at EOF <br />
sed '/^$/N;/\n$/D' # method 2, allows 1 blank at top, 0 at EOF<br />
<br />
===delete all CONSECUTIVE blank lines from file except the first 2:=== <br />
sed '/^$/N;/\n$/N;//D'<br />
<br />
===delete all leading blank lines at top of file=== <br />
sed '/./,$!d'<br />
<br />
===delete all trailing blank lines at end of file=== <br />
sed -e :a -e '/^\n*$/N;/\n$/ba'<br />
<br />
<br />
==SPECIAL APPLICATIONS:==<br />
<br />
===remove nroff overstrikes (char, backspace) from man pages=== <br />
sed "s/.`echo \\\b`//g" # double quotes required for Unix environment <br />
sed 's/.\x08//g' # hex expression for GNU sed (octal is "\010")<br />
<br />
===get Usenet/e-mail message header=== <br />
sed '/^$/q' # deletes everything after first blank line<br />
<br />
===get Usenet/e-mail message body=== <br />
sed '1,/^$/d' # deletes everything up to first blank line<br />
<br />
===get Subject header, but remove initial "Subject: " portion ===<br />
sed '/^Subject: */!d; s///;q'<br />
<br />
===get return address header ===<br />
sed '/^Reply-To:/q; /^From:/h; /./d;g;q'<br />
<br />
===parse out the address proper. Pulls out the e-mail address by itself from the 1-line return address header (see preceding script) ===<br />
sed 's/ *(.*)//; s/>.*//; s/.*[:<] *//'<br />
<br />
===add a leading angle bracket and space to each line (quote a message)=== <br />
sed 's/^/> /<br />
<br />
===delete leading angle bracket & space from each line (unquote a message)=== <br />
sed 's/^> //'<br />
<br />
===remove most HTML tags (accommodates multiple-line tags)=== <br />
sed -e :a -e 's/<[^<]*>/ /g;/</{N;s/\n/ /;ba;}'<br />
<br />
===extract multi-part uuencoded binaries, removing extraneous header info, so that only the uuencoded portion remains. Files passed to sed must be passed in the proper order. Version 1 can be entered from the command line; version 2 can be made into an executable Unix shell script. (Modified from a script by Rahul Dhesi.) ===<br />
sed '/^end/,/^begin/d' file1 file2 ... fileX | uudecode # vers. 1 <br />
sed '/^end/,/^begin/d' $* | uudecode # vers. 2<br />
<br />
===zip up each .TXT file individually, deleting the source file and setting the name of each .ZIP file to the basename of the .TXT file (under DOS: the "dir /b" switch returns bare filenames in all caps).=== <br />
echo @echo off >zipup.bat <br />
dir /b *.txt | sed "s/^\(.*\)\.TXT/pkzip -mo \1 \1.TXT/" >>zipup.bat<br />
<br />
<br />
==TYPICAL USE:==<br />
;Sed takes one or more editing commands and applies all of them, in sequence, to each line of input. After all the commands have been applied to the first input line, that line is output and a second input line is taken for processing, and the cycle repeats. The preceding examples assume that input comes from the standard input device (i.e, the console, normally this will be piped input). One or more filenames can be appended to the command line if the input does not come from stdin. Output is sent to stdout (the screen). Thus:<br />
<br />
cat filename | sed '10q' # uses piped input <br />
sed '10q' filename # same effect, avoids a useless "cat" <br />
sed '10q' filename > newfile # redirects output to disk<br />
<br />
;For additional syntax instructions, including the way to apply editing commands from a disk file instead of the command line, consult "sed & awk, 2nd Edition," by Dale Dougherty and Arnold Robbins (O'Reilly, 1997; http://www.ora.com), "UNIX Text Processing," by Dale Dougherty and Tim O'Reilly (Hayden Books, 1987) or the tutorials by Mike Arst distributed in U-SEDIT2.ZIP (many sites). To fully exploit the power of sed, one must understand "regular expressions." For this, see "Mastering Regular Expressions" by Jeffrey Friedl (O'Reilly, 1997). The manual ("man") pages on Unix systems may be helpful (try "man sed", "man regexp", or the subsection on regular expressions in "man ed"), but man pages are notoriously difficult. They are not written to teach sed use or regexps to first-time users, but as a reference text for those already acquainted with these tools. <br />
<br />
<br />
==QUOTING SYNTAX:==<br />
;The preceding examples use single quotes ('...') instead of double quotes ("...") to enclose editing commands, since sed is typically used on a Unix platform. Single quotes prevent the Unix shell from intrepreting the dollar sign ($) and backquotes (`...`), which are expanded by the shell if they are enclosed in double quotes. Users of the "csh" shell and derivatives will also need to quote the exclamation mark (!) with the backslash (i.e., \!) to properly run the examples listed above, even within single quotes. Versions of sed written for DOS invariably require double quotes ("...") instead of single quotes to enclose editing commands. <br />
<br />
;USE OF '\t' IN SED SCRIPTS: For clarity in documentation, we have used the expression '\t' to indicate a tab character (0x09) in the scripts. However, most versions of sed do not recognize the '\t' abbreviation, so when typing these scripts from the command line, you should press the TAB key instead. '\t' is supported as a regular expression metacharacter in awk, perl, and in a few implementations of sed. <br />
<br />
<br />
==VERSIONS OF SED:==<br />
;Versions of sed do differ, and some slight syntax variation is to be expected. In particular, most do not support the use of labels (:name) or branch instructions (b,t) within editing commands, except at the end of those commands. We have used the syntax which will be portable to most users of sed, even though the popular GNU versions of sed allow a more succinct syntax. When the reader sees a fairly long command such as this: <br />
<br />
sed -e '/AAA/b' -e '/BBB/b' -e '/CCC/b' -e d<br />
<br />
;it is heartening to know that GNU sed will let you reduce it to:<br />
<br />
sed '/AAA/b;/BBB/b;/CCC/b;d'<br />
<br />
;In addition, remember that while many versions of sed accept a command like "/one/ s/RE1/RE2/", some do NOT allow "/one/! s/RE1/RE2/", which contains space before the 's'. Omit the space when typing the command.<br />
<br />
<br />
==OPTIMIZING FOR SPEED:==<br />
;If execution speed needs to be increased (due to large input files or slow processors or hard disks), substitution will be executed more quickly if the "find" expression is specified before giving the "s/.../.../" instruction. Thus:<br />
<br />
sed 's/foo/bar/g' filename # standard replace command <br />
sed '/foo/ s/foo/bar/g' filename # executes more quickly <br />
sed '/foo/ s//bar/g' filename # shorthand sed syntax<br />
<br />
;On line selection or deletion in which you only need to output lines from the first part of the file, a "quit" command (q) in the script will drastically reduce processing time for large files. Thus:<br />
<br />
sed -n '45,50p' filename # print line nos. 45-50 of a file <br />
sed -n '51q;45,50p' filename # same, but executes much faster<br />
<br />
;If you have any additional scripts to contribute or if you find errors in this document, please send e-mail to the compiler. Indicate the version of sed you used, the operating system it was compiled for, and the nature of the problem. Various scripts in this file were written or contributed by:<br />
<br />
Al Aab <af137@freenet.toronto.on.ca> # "seders" list moderator <br />
Dale Dougherty <dale@songline.com> # author of "sed & awk" <br />
Carlos Duarte <cdua@algos.inesc.pt> # author of "do it with sed" <br />
Eric Pement <epement@jpusa.chi.il.us> # author of this document <br />
S.G.Ravenhall < S.G.Ravenhall@open.ac.uk> # great de-html script <br />
Greg Ubben <gsu@romulus.ncsc.mil> # many contributions & much help<br />
<br />
==Additional SED Commands==<br />
===Lowercase to Upercase===<br />
sed ’s/./\u&/g’<br />
</pre></div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=Linux_Related&diff=104Linux Related2014-05-13T17:43:29Z<p>Tjmustard: /* Linux Programs */</p>
<hr />
<div>===General Commands===<br />
<br />
<br />
<br />
===Linux Programs===<br />
[[VIM]]<br />
<br />
[[SED]]<br />
<br />
[[AWK]]</div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=AWK&diff=101AWK2014-05-13T17:42:47Z<p>Tjmustard: /* Handy One Liners */</p>
<hr />
<div>===General use:===<br />
AWK can be used to:<br />
# grab a specific substring from a larger string<br />
# do basic math<br />
<br />
==Grabbing a substring==<br />
#echo "This is a large string."|awk '{print $1}'<br />
This<br />
<br />
#echo "This is a large string."|awk '{print $4}'<br />
large<br />
<br />
==Basic Math==<br />
#count=5<br />
#echo $count|awk '{print $1 + 1}'<br />
6<br />
<br />
#energy=-1283.5795938<br />
#echo $energy|awk '{print $1/4.184}'<br />
-306.782885707<br />
<br />
<br />
<br />
-----<br />
===Handy One Liners===<br />
<pre><br />
HANDY ONE-LINERS FOR AWK 22 July 2003<br />
compiled by Eric Pement <pemente@northpark.edu> version 0.22<br />
Latest version of this file is usually at:<br />
http://www.student.northpark.edu/pemente/awk/awk1line.txt<br />
<br />
<br />
USAGE:<br />
<br />
Unix: awk '/pattern/ {print "$1"}' # standard Unix shells<br />
DOS/Win: awk '/pattern/ {print "$1"}' # okay for DJGPP compiled<br />
awk "/pattern/ {print \"$1\"}" # required for Mingw32<br />
<br />
Most of my experience comes from version of GNU awk (gawk) compiled for<br />
Win32. Note in particular that DJGPP compilations permit the awk script<br />
to follow Unix quoting syntax '/like/ {"this"}'. However, the user must<br />
know that single quotes under DOS/Windows do not protect the redirection<br />
arrows (<, >) nor do they protect pipes (|). Both are special symbols<br />
for the DOS/CMD command shell and their special meaning is ignored only<br />
if they are placed within "double quotes." Likewise, DOS/Win users must<br />
remember that the percent sign (%) is used to mark DOS/Win environment<br />
variables, so it must be doubled (%%) to yield a single percent sign<br />
visible to awk.<br />
<br />
If I am sure that a script will NOT need to be quoted in Unix, DOS, or<br />
CMD, then I normally omit the quote marks. If an example is peculiar to<br />
GNU awk, the command 'gawk' will be used. Please notify me if you find<br />
errors or new commands to add to this list (total length under 65<br />
characters). I usually try to put the shortest script first.<br />
<br />
FILE SPACING:<br />
<br />
# double space a file<br />
awk '1;{print ""}'<br />
awk 'BEGIN{ORS="\n\n"};1'<br />
<br />
# double space a file which already has blank lines in it. Output file<br />
# should contain no more than one blank line between lines of text.<br />
# NOTE: On Unix systems, DOS lines which have only CRLF (\r\n) are<br />
# often treated as non-blank, and thus 'NF' alone will return TRUE.<br />
awk 'NF{print $0 "\n"}'<br />
<br />
# triple space a file<br />
awk '1;{print "\n"}'<br />
<br />
NUMBERING AND CALCULATIONS:<br />
<br />
# precede each line by its line number FOR THAT FILE (left alignment).<br />
# Using a tab (\t) instead of space will preserve margins.<br />
awk '{print FNR "\t" $0}' files*<br />
<br />
# precede each line by its line number FOR ALL FILES TOGETHER, with tab.<br />
awk '{print NR "\t" $0}' files*<br />
<br />
# number each line of a file (number on left, right-aligned)<br />
# Double the percent signs if typing from the DOS command prompt.<br />
awk '{printf("%5d : %s\n", NR,$0)}'<br />
<br />
# number each line of file, but only print numbers if line is not blank<br />
# Remember caveats about Unix treatment of \r (mentioned above)<br />
awk 'NF{$0=++a " :" $0};{print}'<br />
awk '{print (NF? ++a " :" :"") $0}'<br />
<br />
# count lines (emulates "wc -l")<br />
awk 'END{print NR}'<br />
<br />
# print the sums of the fields of every line<br />
awk '{s=0; for (i=1; i<=NF; i++) s=s+$i; print s}'<br />
<br />
# add all fields in all lines and print the sum<br />
awk '{for (i=1; i<=NF; i++) s=s+$i}; END{print s}'<br />
<br />
# print every line after replacing each field with its absolute value<br />
awk '{for (i=1; i<=NF; i++) if ($i < 0) $i = -$i; print }'<br />
awk '{for (i=1; i<=NF; i++) $i = ($i < 0) ? -$i : $i; print }'<br />
<br />
# print the total number of fields ("words") in all lines<br />
awk '{ total = total + NF }; END {print total}' file<br />
<br />
# print the total number of lines that contain "Beth"<br />
awk '/Beth/{n++}; END {print n+0}' file<br />
<br />
# print the largest first field and the line that contains it<br />
# Intended for finding the longest string in field #1<br />
awk '$1 > max {max=$1; maxline=$0}; END{ print max, maxline}'<br />
<br />
# print the number of fields in each line, followed by the line<br />
awk '{ print NF ":" $0 } '<br />
<br />
# print the last field of each line<br />
awk '{ print $NF }'<br />
<br />
# print the last field of the last line<br />
awk '{ field = $NF }; END{ print field }'<br />
<br />
# print every line with more than 4 fields<br />
awk 'NF > 4'<br />
<br />
# print every line where the value of the last field is > 4<br />
awk '$NF > 4'<br />
<br />
<br />
TEXT CONVERSION AND SUBSTITUTION:<br />
<br />
# IN UNIX ENVIRONMENT: convert DOS newlines (CR/LF) to Unix format<br />
awk '{sub(/\r$/,"");print}' # assumes EACH line ends with Ctrl-M<br />
<br />
# IN UNIX ENVIRONMENT: convert Unix newlines (LF) to DOS format<br />
awk '{sub(/$/,"\r");print}<br />
<br />
# IN DOS ENVIRONMENT: convert Unix newlines (LF) to DOS format<br />
awk 1<br />
<br />
# IN DOS ENVIRONMENT: convert DOS newlines (CR/LF) to Unix format<br />
# Cannot be done with DOS versions of awk, other than gawk:<br />
gawk -v BINMODE="w" '1' infile >outfile<br />
<br />
# Use "tr" instead.<br />
tr -d \r <infile >outfile # GNU tr version 1.22 or higher<br />
<br />
# delete leading whitespace (spaces, tabs) from front of each line<br />
# aligns all text flush left<br />
awk '{sub(/^[ \t]+/, ""); print}'<br />
<br />
# delete trailing whitespace (spaces, tabs) from end of each line<br />
awk '{sub(/[ \t]+$/, "");print}'<br />
<br />
# delete BOTH leading and trailing whitespace from each line<br />
awk '{gsub(/^[ \t]+|[ \t]+$/,"");print}'<br />
awk '{$1=$1;print}' # also removes extra space between fields<br />
<br />
# insert 5 blank spaces at beginning of each line (make page offset)<br />
awk '{sub(/^/, " ");print}'<br />
<br />
# align all text flush right on a 79-column width<br />
awk '{printf "%79s\n", $0}' file*<br />
<br />
# center all text on a 79-character width<br />
awk '{l=length();s=int((79-l)/2); printf "%"(s+l)"s\n",$0}' file*<br />
<br />
# substitute (find and replace) "foo" with "bar" on each line<br />
awk '{sub(/foo/,"bar");print}' # replaces only 1st instance<br />
gawk '{$0=gensub(/foo/,"bar",4);print}' # replaces only 4th instance<br />
awk '{gsub(/foo/,"bar");print}' # replaces ALL instances in a line<br />
<br />
# substitute "foo" with "bar" ONLY for lines which contain "baz"<br />
awk '/baz/{gsub(/foo/, "bar")};{print}'<br />
<br />
# substitute "foo" with "bar" EXCEPT for lines which contain "baz"<br />
awk '!/baz/{gsub(/foo/, "bar")};{print}'<br />
<br />
# change "scarlet" or "ruby" or "puce" to "red"<br />
awk '{gsub(/scarlet|ruby|puce/, "red"); print}'<br />
<br />
# reverse order of lines (emulates "tac")<br />
awk '{a[i++]=$0} END {for (j=i-1; j>=0;) print a[j--] }' file*<br />
<br />
# if a line ends with a backslash, append the next line to it<br />
# (fails if there are multiple lines ending with backslash...)<br />
awk '/\\$/ {sub(/\\$/,""); getline t; print $0 t; next}; 1' file*<br />
<br />
# print and sort the login names of all users<br />
awk -F ":" '{ print $1 | "sort" }' /etc/passwd<br />
<br />
# print the first 2 fields, in opposite order, of every line<br />
awk '{print $2, $1}' file<br />
<br />
# switch the first 2 fields of every line<br />
awk '{temp = $1; $1 = $2; $2 = temp}' file<br />
<br />
# print every line, deleting the second field of that line<br />
awk '{ $2 = ""; print }'<br />
<br />
# print in reverse order the fields of every line<br />
awk '{for (i=NF; i>0; i--) printf("%s ",i);printf ("\n")}' file<br />
<br />
# remove duplicate, consecutive lines (emulates "uniq")<br />
awk 'a !~ $0; {a=$0}'<br />
<br />
# remove duplicate, nonconsecutive lines<br />
awk '! a[$0]++' # most concise script<br />
awk '!($0 in a) {a[$0];print}' # most efficient script<br />
<br />
# concatenate every 5 lines of input, using a comma separator<br />
# between fields<br />
awk 'ORS=%NR%5?",":"\n"' file<br />
<br />
<br />
<br />
SELECTIVE PRINTING OF CERTAIN LINES:<br />
<br />
# print first 10 lines of file (emulates behavior of "head")<br />
awk 'NR < 11'<br />
<br />
# print first line of file (emulates "head -1")<br />
awk 'NR>1{exit};1'<br />
<br />
# print the last 2 lines of a file (emulates "tail -2")<br />
awk '{y=x "\n" $0; x=$0};END{print y}'<br />
<br />
# print the last line of a file (emulates "tail -1")<br />
awk 'END{print}'<br />
<br />
# print only lines which match regular expression (emulates "grep")<br />
awk '/regex/'<br />
<br />
# print only lines which do NOT match regex (emulates "grep -v")<br />
awk '!/regex/'<br />
<br />
# print the line immediately before a regex, but not the line<br />
# containing the regex<br />
awk '/regex/{print x};{x=$0}'<br />
awk '/regex/{print (x=="" ? "match on line 1" : x)};{x=$0}'<br />
<br />
# print the line immediately after a regex, but not the line<br />
# containing the regex<br />
awk '/regex/{getline;print}'<br />
<br />
# grep for AAA and BBB and CCC (in any order)<br />
awk '/AAA/; /BBB/; /CCC/'<br />
<br />
# grep for AAA and BBB and CCC (in that order)<br />
awk '/AAA.*BBB.*CCC/'<br />
<br />
# print only lines of 65 characters or longer<br />
awk 'length > 64'<br />
<br />
# print only lines of less than 65 characters<br />
awk 'length < 64'<br />
<br />
# print section of file from regular expression to end of file<br />
awk '/regex/,0'<br />
awk '/regex/,EOF'<br />
<br />
# print section of file based on line numbers (lines 8-12, inclusive)<br />
awk 'NR==8,NR==12'<br />
<br />
# print line number 52<br />
awk 'NR==52'<br />
awk 'NR==52 {print;exit}' # more efficient on large files<br />
<br />
# print section of file between two regular expressions (inclusive)<br />
awk '/Iowa/,/Montana/' # case sensitive<br />
<br />
<br />
SELECTIVE DELETION OF CERTAIN LINES:<br />
<br />
# delete ALL blank lines from a file (same as "grep '.' ")<br />
awk NF<br />
awk '/./'<br />
<br />
<br />
CREDITS AND THANKS:<br />
<br />
Special thanks to Peter S. Tillier for helping me with the first release<br />
of this FAQ file.<br />
<br />
For additional syntax instructions, including the way to apply editing<br />
commands from a disk file instead of the command line, consult:<br />
<br />
"sed & awk, 2nd Edition," by Dale Dougherty and Arnold Robbins<br />
O'Reilly, 1997<br />
"UNIX Text Processing," by Dale Dougherty and Tim O'Reilly<br />
Hayden Books, 1987<br />
"Effective awk Programming, 3rd Edition." by Arnold Robbins<br />
O'Reilly, 2001<br />
<br />
To fully exploit the power of awk, one must understand "regular<br />
expressions." For detailed discussion of regular expressions, see<br />
"Mastering Regular Expressions, 2d edition" by Jeffrey Friedl<br />
(O'Reilly, 2002).<br />
<br />
The manual ("man") pages on Unix systems may be helpful (try "man awk",<br />
"man nawk", "man regexp", or the section on regular expressions in "man<br />
ed"), but man pages are notoriously difficult. They are not written to<br />
teach awk use or regexps to first-time users, but as a reference text<br />
for those already acquainted with these tools.<br />
<br />
USE OF '\t' IN awk SCRIPTS: For clarity in documentation, we have used<br />
the expression '\t' to indicate a tab character (0x09) in the scripts.<br />
All versions of awk, even the UNIX System 7 version should recognize<br />
the '\t' abbreviation.<br />
</pre></div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=AWK&diff=99AWK2014-05-13T17:40:56Z<p>Tjmustard: </p>
<hr />
<div>===General use:===<br />
AWK can be used to:<br />
# grab a specific substring from a larger string<br />
# do basic math<br />
<br />
==Grabbing a substring==<br />
#echo "This is a large string."|awk '{print $1}'<br />
This<br />
<br />
#echo "This is a large string."|awk '{print $4}'<br />
large<br />
<br />
==Basic Math==<br />
#count=5<br />
#echo $count|awk '{print $1 + 1}'<br />
6<br />
<br />
#energy=-1283.5795938<br />
#echo $energy|awk '{print $1/4.184}'<br />
-306.782885707<br />
<br />
<br />
<br />
-----<br />
===Handy One Liners===<br />
<nowiki>HANDY ONE-LINERS FOR AWK 22 July 2003<br />
compiled by Eric Pement <pemente@northpark.edu> version 0.22<br />
Latest version of this file is usually at:<br />
http://www.student.northpark.edu/pemente/awk/awk1line.txt<br />
<br />
<br />
USAGE:<br />
<br />
Unix: awk '/pattern/ {print "$1"}' # standard Unix shells<br />
DOS/Win: awk '/pattern/ {print "$1"}' # okay for DJGPP compiled<br />
awk "/pattern/ {print \"$1\"}" # required for Mingw32<br />
<br />
Most of my experience comes from version of GNU awk (gawk) compiled for<br />
Win32. Note in particular that DJGPP compilations permit the awk script<br />
to follow Unix quoting syntax '/like/ {"this"}'. However, the user must<br />
know that single quotes under DOS/Windows do not protect the redirection<br />
arrows (<, >) nor do they protect pipes (|). Both are special symbols<br />
for the DOS/CMD command shell and their special meaning is ignored only<br />
if they are placed within "double quotes." Likewise, DOS/Win users must<br />
remember that the percent sign (%) is used to mark DOS/Win environment<br />
variables, so it must be doubled (%%) to yield a single percent sign<br />
visible to awk.<br />
<br />
If I am sure that a script will NOT need to be quoted in Unix, DOS, or<br />
CMD, then I normally omit the quote marks. If an example is peculiar to<br />
GNU awk, the command 'gawk' will be used. Please notify me if you find<br />
errors or new commands to add to this list (total length under 65<br />
characters). I usually try to put the shortest script first.<br />
<br />
FILE SPACING:<br />
<br />
# double space a file<br />
awk '1;{print ""}'<br />
awk 'BEGIN{ORS="\n\n"};1'<br />
<br />
# double space a file which already has blank lines in it. Output file<br />
# should contain no more than one blank line between lines of text.<br />
# NOTE: On Unix systems, DOS lines which have only CRLF (\r\n) are<br />
# often treated as non-blank, and thus 'NF' alone will return TRUE.<br />
awk 'NF{print $0 "\n"}'<br />
<br />
# triple space a file<br />
awk '1;{print "\n"}'<br />
<br />
NUMBERING AND CALCULATIONS:<br />
<br />
# precede each line by its line number FOR THAT FILE (left alignment).<br />
# Using a tab (\t) instead of space will preserve margins.<br />
awk '{print FNR "\t" $0}' files*<br />
<br />
# precede each line by its line number FOR ALL FILES TOGETHER, with tab.<br />
awk '{print NR "\t" $0}' files*<br />
<br />
# number each line of a file (number on left, right-aligned)<br />
# Double the percent signs if typing from the DOS command prompt.<br />
awk '{printf("%5d : %s\n", NR,$0)}'<br />
<br />
# number each line of file, but only print numbers if line is not blank<br />
# Remember caveats about Unix treatment of \r (mentioned above)<br />
awk 'NF{$0=++a " :" $0};{print}'<br />
awk '{print (NF? ++a " :" :"") $0}'<br />
<br />
# count lines (emulates "wc -l")<br />
awk 'END{print NR}'<br />
<br />
# print the sums of the fields of every line<br />
awk '{s=0; for (i=1; i<=NF; i++) s=s+$i; print s}'<br />
<br />
# add all fields in all lines and print the sum<br />
awk '{for (i=1; i<=NF; i++) s=s+$i}; END{print s}'<br />
<br />
# print every line after replacing each field with its absolute value<br />
awk '{for (i=1; i<=NF; i++) if ($i < 0) $i = -$i; print }'<br />
awk '{for (i=1; i<=NF; i++) $i = ($i < 0) ? -$i : $i; print }'<br />
<br />
# print the total number of fields ("words") in all lines<br />
awk '{ total = total + NF }; END {print total}' file<br />
<br />
# print the total number of lines that contain "Beth"<br />
awk '/Beth/{n++}; END {print n+0}' file<br />
<br />
# print the largest first field and the line that contains it<br />
# Intended for finding the longest string in field #1<br />
awk '$1 > max {max=$1; maxline=$0}; END{ print max, maxline}'<br />
<br />
# print the number of fields in each line, followed by the line<br />
awk '{ print NF ":" $0 } '<br />
<br />
# print the last field of each line<br />
awk '{ print $NF }'<br />
<br />
# print the last field of the last line<br />
awk '{ field = $NF }; END{ print field }'<br />
<br />
# print every line with more than 4 fields<br />
awk 'NF > 4'<br />
<br />
# print every line where the value of the last field is > 4<br />
awk '$NF > 4'<br />
<br />
<br />
TEXT CONVERSION AND SUBSTITUTION:<br />
<br />
# IN UNIX ENVIRONMENT: convert DOS newlines (CR/LF) to Unix format<br />
awk '{sub(/\r$/,"");print}' # assumes EACH line ends with Ctrl-M<br />
<br />
# IN UNIX ENVIRONMENT: convert Unix newlines (LF) to DOS format<br />
awk '{sub(/$/,"\r");print}<br />
<br />
# IN DOS ENVIRONMENT: convert Unix newlines (LF) to DOS format<br />
awk 1<br />
<br />
# IN DOS ENVIRONMENT: convert DOS newlines (CR/LF) to Unix format<br />
# Cannot be done with DOS versions of awk, other than gawk:<br />
gawk -v BINMODE="w" '1' infile >outfile<br />
<br />
# Use "tr" instead.<br />
tr -d \r <infile >outfile # GNU tr version 1.22 or higher<br />
<br />
# delete leading whitespace (spaces, tabs) from front of each line<br />
# aligns all text flush left<br />
awk '{sub(/^[ \t]+/, ""); print}'<br />
<br />
# delete trailing whitespace (spaces, tabs) from end of each line<br />
awk '{sub(/[ \t]+$/, "");print}'<br />
<br />
# delete BOTH leading and trailing whitespace from each line<br />
awk '{gsub(/^[ \t]+|[ \t]+$/,"");print}'<br />
awk '{$1=$1;print}' # also removes extra space between fields<br />
<br />
# insert 5 blank spaces at beginning of each line (make page offset)<br />
awk '{sub(/^/, " ");print}'<br />
<br />
# align all text flush right on a 79-column width<br />
awk '{printf "%79s\n", $0}' file*<br />
<br />
# center all text on a 79-character width<br />
awk '{l=length();s=int((79-l)/2); printf "%"(s+l)"s\n",$0}' file*<br />
<br />
# substitute (find and replace) "foo" with "bar" on each line<br />
awk '{sub(/foo/,"bar");print}' # replaces only 1st instance<br />
gawk '{$0=gensub(/foo/,"bar",4);print}' # replaces only 4th instance<br />
awk '{gsub(/foo/,"bar");print}' # replaces ALL instances in a line<br />
<br />
# substitute "foo" with "bar" ONLY for lines which contain "baz"<br />
awk '/baz/{gsub(/foo/, "bar")};{print}'<br />
<br />
# substitute "foo" with "bar" EXCEPT for lines which contain "baz"<br />
awk '!/baz/{gsub(/foo/, "bar")};{print}'<br />
<br />
# change "scarlet" or "ruby" or "puce" to "red"<br />
awk '{gsub(/scarlet|ruby|puce/, "red"); print}'<br />
<br />
# reverse order of lines (emulates "tac")<br />
awk '{a[i++]=$0} END {for (j=i-1; j>=0;) print a[j--] }' file*<br />
<br />
# if a line ends with a backslash, append the next line to it<br />
# (fails if there are multiple lines ending with backslash...)<br />
awk '/\\$/ {sub(/\\$/,""); getline t; print $0 t; next}; 1' file*<br />
<br />
# print and sort the login names of all users<br />
awk -F ":" '{ print $1 | "sort" }' /etc/passwd<br />
<br />
# print the first 2 fields, in opposite order, of every line<br />
awk '{print $2, $1}' file<br />
<br />
# switch the first 2 fields of every line<br />
awk '{temp = $1; $1 = $2; $2 = temp}' file<br />
<br />
# print every line, deleting the second field of that line<br />
awk '{ $2 = ""; print }'<br />
<br />
# print in reverse order the fields of every line<br />
awk '{for (i=NF; i>0; i--) printf("%s ",i);printf ("\n")}' file<br />
<br />
# remove duplicate, consecutive lines (emulates "uniq")<br />
awk 'a !~ $0; {a=$0}'<br />
<br />
# remove duplicate, nonconsecutive lines<br />
awk '! a[$0]++' # most concise script<br />
awk '!($0 in a) {a[$0];print}' # most efficient script<br />
<br />
# concatenate every 5 lines of input, using a comma separator<br />
# between fields<br />
awk 'ORS=%NR%5?",":"\n"' file<br />
<br />
<br />
<br />
SELECTIVE PRINTING OF CERTAIN LINES:<br />
<br />
# print first 10 lines of file (emulates behavior of "head")<br />
awk 'NR < 11'<br />
<br />
# print first line of file (emulates "head -1")<br />
awk 'NR>1{exit};1'<br />
<br />
# print the last 2 lines of a file (emulates "tail -2")<br />
awk '{y=x "\n" $0; x=$0};END{print y}'<br />
<br />
# print the last line of a file (emulates "tail -1")<br />
awk 'END{print}'<br />
<br />
# print only lines which match regular expression (emulates "grep")<br />
awk '/regex/'<br />
<br />
# print only lines which do NOT match regex (emulates "grep -v")<br />
awk '!/regex/'<br />
<br />
# print the line immediately before a regex, but not the line<br />
# containing the regex<br />
awk '/regex/{print x};{x=$0}'<br />
awk '/regex/{print (x=="" ? "match on line 1" : x)};{x=$0}'<br />
<br />
# print the line immediately after a regex, but not the line<br />
# containing the regex<br />
awk '/regex/{getline;print}'<br />
<br />
# grep for AAA and BBB and CCC (in any order)<br />
awk '/AAA/; /BBB/; /CCC/'<br />
<br />
# grep for AAA and BBB and CCC (in that order)<br />
awk '/AAA.*BBB.*CCC/'<br />
<br />
# print only lines of 65 characters or longer<br />
awk 'length > 64'<br />
<br />
# print only lines of less than 65 characters<br />
awk 'length < 64'<br />
<br />
# print section of file from regular expression to end of file<br />
awk '/regex/,0'<br />
awk '/regex/,EOF'<br />
<br />
# print section of file based on line numbers (lines 8-12, inclusive)<br />
awk 'NR==8,NR==12'<br />
<br />
# print line number 52<br />
awk 'NR==52'<br />
awk 'NR==52 {print;exit}' # more efficient on large files<br />
<br />
# print section of file between two regular expressions (inclusive)<br />
awk '/Iowa/,/Montana/' # case sensitive<br />
<br />
<br />
SELECTIVE DELETION OF CERTAIN LINES:<br />
<br />
# delete ALL blank lines from a file (same as "grep '.' ")<br />
awk NF<br />
awk '/./'<br />
<br />
<br />
CREDITS AND THANKS:<br />
<br />
Special thanks to Peter S. Tillier for helping me with the first release<br />
of this FAQ file.<br />
<br />
For additional syntax instructions, including the way to apply editing<br />
commands from a disk file instead of the command line, consult:<br />
<br />
"sed & awk, 2nd Edition," by Dale Dougherty and Arnold Robbins<br />
O'Reilly, 1997<br />
"UNIX Text Processing," by Dale Dougherty and Tim O'Reilly<br />
Hayden Books, 1987<br />
"Effective awk Programming, 3rd Edition." by Arnold Robbins<br />
O'Reilly, 2001<br />
<br />
To fully exploit the power of awk, one must understand "regular<br />
expressions." For detailed discussion of regular expressions, see<br />
"Mastering Regular Expressions, 2d edition" by Jeffrey Friedl<br />
(O'Reilly, 2002).<br />
<br />
The manual ("man") pages on Unix systems may be helpful (try "man awk",<br />
"man nawk", "man regexp", or the section on regular expressions in "man<br />
ed"), but man pages are notoriously difficult. They are not written to<br />
teach awk use or regexps to first-time users, but as a reference text<br />
for those already acquainted with these tools.<br />
<br />
USE OF '\t' IN awk SCRIPTS: For clarity in documentation, we have used<br />
the expression '\t' to indicate a tab character (0x09) in the scripts.<br />
All versions of awk, even the UNIX System 7 version should recognize<br />
the '\t' abbreviation.<br />
</nowiki></div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=AWK&diff=98AWK2014-05-13T17:37:34Z<p>Tjmustard: </p>
<hr />
<div>===General use:===<br />
AWK can be used to:<br />
# grab a specific substring from a larger string<br />
# do basic math<br />
<br />
==Grabing a substring==<br />
#echo "This is a large string."|awk '{print $1}'<br />
This<br />
<br />
#echo "This is a large string."|awk '{print $4}'<br />
large<br />
<br />
-----<br />
===Handy One Liners===<br />
HANDY ONE-LINERS FOR AWK 22 July 2003<br />
compiled by Eric Pement <pemente@northpark.edu> version 0.22<br />
Latest version of this file is usually at:<br />
http://www.student.northpark.edu/pemente/awk/awk1line.txt<br />
<br />
<br />
USAGE:<br />
<br />
Unix: awk '/pattern/ {print "$1"}' # standard Unix shells<br />
DOS/Win: awk '/pattern/ {print "$1"}' # okay for DJGPP compiled<br />
awk "/pattern/ {print \"$1\"}" # required for Mingw32<br />
<br />
Most of my experience comes from version of GNU awk (gawk) compiled for<br />
Win32. Note in particular that DJGPP compilations permit the awk script<br />
to follow Unix quoting syntax '/like/ {"this"}'. However, the user must<br />
know that single quotes under DOS/Windows do not protect the redirection<br />
arrows (<, >) nor do they protect pipes (|). Both are special symbols<br />
for the DOS/CMD command shell and their special meaning is ignored only<br />
if they are placed within "double quotes." Likewise, DOS/Win users must<br />
remember that the percent sign (%) is used to mark DOS/Win environment<br />
variables, so it must be doubled (%%) to yield a single percent sign<br />
visible to awk.<br />
<br />
If I am sure that a script will NOT need to be quoted in Unix, DOS, or<br />
CMD, then I normally omit the quote marks. If an example is peculiar to<br />
GNU awk, the command 'gawk' will be used. Please notify me if you find<br />
errors or new commands to add to this list (total length under 65<br />
characters). I usually try to put the shortest script first.<br />
<br />
FILE SPACING:<br />
<br />
# double space a file<br />
awk '1;{print ""}'<br />
awk 'BEGIN{ORS="\n\n"};1'<br />
<br />
# double space a file which already has blank lines in it. Output file<br />
# should contain no more than one blank line between lines of text.<br />
# NOTE: On Unix systems, DOS lines which have only CRLF (\r\n) are<br />
# often treated as non-blank, and thus 'NF' alone will return TRUE.<br />
awk 'NF{print $0 "\n"}'<br />
<br />
# triple space a file<br />
awk '1;{print "\n"}'<br />
<br />
NUMBERING AND CALCULATIONS:<br />
<br />
# precede each line by its line number FOR THAT FILE (left alignment).<br />
# Using a tab (\t) instead of space will preserve margins.<br />
awk '{print FNR "\t" $0}' files*<br />
<br />
# precede each line by its line number FOR ALL FILES TOGETHER, with tab.<br />
awk '{print NR "\t" $0}' files*<br />
<br />
# number each line of a file (number on left, right-aligned)<br />
# Double the percent signs if typing from the DOS command prompt.<br />
awk '{printf("%5d : %s\n", NR,$0)}'<br />
<br />
# number each line of file, but only print numbers if line is not blank<br />
# Remember caveats about Unix treatment of \r (mentioned above)<br />
awk 'NF{$0=++a " :" $0};{print}'<br />
awk '{print (NF? ++a " :" :"") $0}'<br />
<br />
# count lines (emulates "wc -l")<br />
awk 'END{print NR}'<br />
<br />
# print the sums of the fields of every line<br />
awk '{s=0; for (i=1; i<=NF; i++) s=s+$i; print s}'<br />
<br />
# add all fields in all lines and print the sum<br />
awk '{for (i=1; i<=NF; i++) s=s+$i}; END{print s}'<br />
<br />
# print every line after replacing each field with its absolute value<br />
awk '{for (i=1; i<=NF; i++) if ($i < 0) $i = -$i; print }'<br />
awk '{for (i=1; i<=NF; i++) $i = ($i < 0) ? -$i : $i; print }'<br />
<br />
# print the total number of fields ("words") in all lines<br />
awk '{ total = total + NF }; END {print total}' file<br />
<br />
# print the total number of lines that contain "Beth"<br />
awk '/Beth/{n++}; END {print n+0}' file<br />
<br />
# print the largest first field and the line that contains it<br />
# Intended for finding the longest string in field #1<br />
awk '$1 > max {max=$1; maxline=$0}; END{ print max, maxline}'<br />
<br />
# print the number of fields in each line, followed by the line<br />
awk '{ print NF ":" $0 } '<br />
<br />
# print the last field of each line<br />
awk '{ print $NF }'<br />
<br />
# print the last field of the last line<br />
awk '{ field = $NF }; END{ print field }'<br />
<br />
# print every line with more than 4 fields<br />
awk 'NF > 4'<br />
<br />
# print every line where the value of the last field is > 4<br />
awk '$NF > 4'<br />
<br />
<br />
TEXT CONVERSION AND SUBSTITUTION:<br />
<br />
# IN UNIX ENVIRONMENT: convert DOS newlines (CR/LF) to Unix format<br />
awk '{sub(/\r$/,"");print}' # assumes EACH line ends with Ctrl-M<br />
<br />
# IN UNIX ENVIRONMENT: convert Unix newlines (LF) to DOS format<br />
awk '{sub(/$/,"\r");print}<br />
<br />
# IN DOS ENVIRONMENT: convert Unix newlines (LF) to DOS format<br />
awk 1<br />
<br />
# IN DOS ENVIRONMENT: convert DOS newlines (CR/LF) to Unix format<br />
# Cannot be done with DOS versions of awk, other than gawk:<br />
gawk -v BINMODE="w" '1' infile >outfile<br />
<br />
# Use "tr" instead.<br />
tr -d \r <infile >outfile # GNU tr version 1.22 or higher<br />
<br />
# delete leading whitespace (spaces, tabs) from front of each line<br />
# aligns all text flush left<br />
awk '{sub(/^[ \t]+/, ""); print}'<br />
<br />
# delete trailing whitespace (spaces, tabs) from end of each line<br />
awk '{sub(/[ \t]+$/, "");print}'<br />
<br />
# delete BOTH leading and trailing whitespace from each line<br />
awk '{gsub(/^[ \t]+|[ \t]+$/,"");print}'<br />
awk '{$1=$1;print}' # also removes extra space between fields<br />
<br />
# insert 5 blank spaces at beginning of each line (make page offset)<br />
awk '{sub(/^/, " ");print}'<br />
<br />
# align all text flush right on a 79-column width<br />
awk '{printf "%79s\n", $0}' file*<br />
<br />
# center all text on a 79-character width<br />
awk '{l=length();s=int((79-l)/2); printf "%"(s+l)"s\n",$0}' file*<br />
<br />
# substitute (find and replace) "foo" with "bar" on each line<br />
awk '{sub(/foo/,"bar");print}' # replaces only 1st instance<br />
gawk '{$0=gensub(/foo/,"bar",4);print}' # replaces only 4th instance<br />
awk '{gsub(/foo/,"bar");print}' # replaces ALL instances in a line<br />
<br />
# substitute "foo" with "bar" ONLY for lines which contain "baz"<br />
awk '/baz/{gsub(/foo/, "bar")};{print}'<br />
<br />
# substitute "foo" with "bar" EXCEPT for lines which contain "baz"<br />
awk '!/baz/{gsub(/foo/, "bar")};{print}'<br />
<br />
# change "scarlet" or "ruby" or "puce" to "red"<br />
awk '{gsub(/scarlet|ruby|puce/, "red"); print}'<br />
<br />
# reverse order of lines (emulates "tac")<br />
awk '{a[i++]=$0} END {for (j=i-1; j>=0;) print a[j--] }' file*<br />
<br />
# if a line ends with a backslash, append the next line to it<br />
# (fails if there are multiple lines ending with backslash...)<br />
awk '/\\$/ {sub(/\\$/,""); getline t; print $0 t; next}; 1' file*<br />
<br />
# print and sort the login names of all users<br />
awk -F ":" '{ print $1 | "sort" }' /etc/passwd<br />
<br />
# print the first 2 fields, in opposite order, of every line<br />
awk '{print $2, $1}' file<br />
<br />
# switch the first 2 fields of every line<br />
awk '{temp = $1; $1 = $2; $2 = temp}' file<br />
<br />
# print every line, deleting the second field of that line<br />
awk '{ $2 = ""; print }'<br />
<br />
# print in reverse order the fields of every line<br />
awk '{for (i=NF; i>0; i--) printf("%s ",i);printf ("\n")}' file<br />
<br />
# remove duplicate, consecutive lines (emulates "uniq")<br />
awk 'a !~ $0; {a=$0}'<br />
<br />
# remove duplicate, nonconsecutive lines<br />
awk '! a[$0]++' # most concise script<br />
awk '!($0 in a) {a[$0];print}' # most efficient script<br />
<br />
# concatenate every 5 lines of input, using a comma separator<br />
# between fields<br />
awk 'ORS=%NR%5?",":"\n"' file<br />
<br />
<br />
<br />
SELECTIVE PRINTING OF CERTAIN LINES:<br />
<br />
# print first 10 lines of file (emulates behavior of "head")<br />
awk 'NR < 11'<br />
<br />
# print first line of file (emulates "head -1")<br />
awk 'NR>1{exit};1'<br />
<br />
# print the last 2 lines of a file (emulates "tail -2")<br />
awk '{y=x "\n" $0; x=$0};END{print y}'<br />
<br />
# print the last line of a file (emulates "tail -1")<br />
awk 'END{print}'<br />
<br />
# print only lines which match regular expression (emulates "grep")<br />
awk '/regex/'<br />
<br />
# print only lines which do NOT match regex (emulates "grep -v")<br />
awk '!/regex/'<br />
<br />
# print the line immediately before a regex, but not the line<br />
# containing the regex<br />
awk '/regex/{print x};{x=$0}'<br />
awk '/regex/{print (x=="" ? "match on line 1" : x)};{x=$0}'<br />
<br />
# print the line immediately after a regex, but not the line<br />
# containing the regex<br />
awk '/regex/{getline;print}'<br />
<br />
# grep for AAA and BBB and CCC (in any order)<br />
awk '/AAA/; /BBB/; /CCC/'<br />
<br />
# grep for AAA and BBB and CCC (in that order)<br />
awk '/AAA.*BBB.*CCC/'<br />
<br />
# print only lines of 65 characters or longer<br />
awk 'length > 64'<br />
<br />
# print only lines of less than 65 characters<br />
awk 'length < 64'<br />
<br />
# print section of file from regular expression to end of file<br />
awk '/regex/,0'<br />
awk '/regex/,EOF'<br />
<br />
# print section of file based on line numbers (lines 8-12, inclusive)<br />
awk 'NR==8,NR==12'<br />
<br />
# print line number 52<br />
awk 'NR==52'<br />
awk 'NR==52 {print;exit}' # more efficient on large files<br />
<br />
# print section of file between two regular expressions (inclusive)<br />
awk '/Iowa/,/Montana/' # case sensitive<br />
<br />
<br />
SELECTIVE DELETION OF CERTAIN LINES:<br />
<br />
# delete ALL blank lines from a file (same as "grep '.' ")<br />
awk NF<br />
awk '/./'<br />
<br />
<br />
CREDITS AND THANKS:<br />
<br />
Special thanks to Peter S. Tillier for helping me with the first release<br />
of this FAQ file.<br />
<br />
For additional syntax instructions, including the way to apply editing<br />
commands from a disk file instead of the command line, consult:<br />
<br />
"sed & awk, 2nd Edition," by Dale Dougherty and Arnold Robbins<br />
O'Reilly, 1997<br />
"UNIX Text Processing," by Dale Dougherty and Tim O'Reilly<br />
Hayden Books, 1987<br />
"Effective awk Programming, 3rd Edition." by Arnold Robbins<br />
O'Reilly, 2001<br />
<br />
To fully exploit the power of awk, one must understand "regular<br />
expressions." For detailed discussion of regular expressions, see<br />
"Mastering Regular Expressions, 2d edition" by Jeffrey Friedl<br />
(O'Reilly, 2002).<br />
<br />
The manual ("man") pages on Unix systems may be helpful (try "man awk",<br />
"man nawk", "man regexp", or the section on regular expressions in "man<br />
ed"), but man pages are notoriously difficult. They are not written to<br />
teach awk use or regexps to first-time users, but as a reference text<br />
for those already acquainted with these tools.<br />
<br />
USE OF '\t' IN awk SCRIPTS: For clarity in documentation, we have used<br />
the expression '\t' to indicate a tab character (0x09) in the scripts.<br />
All versions of awk, even the UNIX System 7 version should recognize<br />
the '\t' abbreviation.</div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=AWK&diff=97AWK2014-05-13T17:37:08Z<p>Tjmustard: </p>
<hr />
<div>===General use:===<br />
AWK can be used to:<br />
# grab a specific substring from a larger string<br />
# do basic math<br />
<br />
==Grabing a substring==<br />
#echo "This is a large string."|awk '{print $1}'<br />
This<br />
<br />
#echo "This is a large string."|awk '{print $4}'<br />
large<br />
<br />
===Handy One Liners===<br />
HANDY ONE-LINERS FOR AWK 22 July 2003<br />
compiled by Eric Pement <pemente@northpark.edu> version 0.22<br />
Latest version of this file is usually at:<br />
http://www.student.northpark.edu/pemente/awk/awk1line.txt<br />
<br />
<br />
USAGE:<br />
<br />
Unix: awk '/pattern/ {print "$1"}' # standard Unix shells<br />
DOS/Win: awk '/pattern/ {print "$1"}' # okay for DJGPP compiled<br />
awk "/pattern/ {print \"$1\"}" # required for Mingw32<br />
<br />
Most of my experience comes from version of GNU awk (gawk) compiled for<br />
Win32. Note in particular that DJGPP compilations permit the awk script<br />
to follow Unix quoting syntax '/like/ {"this"}'. However, the user must<br />
know that single quotes under DOS/Windows do not protect the redirection<br />
arrows (<, >) nor do they protect pipes (|). Both are special symbols<br />
for the DOS/CMD command shell and their special meaning is ignored only<br />
if they are placed within "double quotes." Likewise, DOS/Win users must<br />
remember that the percent sign (%) is used to mark DOS/Win environment<br />
variables, so it must be doubled (%%) to yield a single percent sign<br />
visible to awk.<br />
<br />
If I am sure that a script will NOT need to be quoted in Unix, DOS, or<br />
CMD, then I normally omit the quote marks. If an example is peculiar to<br />
GNU awk, the command 'gawk' will be used. Please notify me if you find<br />
errors or new commands to add to this list (total length under 65<br />
characters). I usually try to put the shortest script first.<br />
<br />
FILE SPACING:<br />
<br />
# double space a file<br />
awk '1;{print ""}'<br />
awk 'BEGIN{ORS="\n\n"};1'<br />
<br />
# double space a file which already has blank lines in it. Output file<br />
# should contain no more than one blank line between lines of text.<br />
# NOTE: On Unix systems, DOS lines which have only CRLF (\r\n) are<br />
# often treated as non-blank, and thus 'NF' alone will return TRUE.<br />
awk 'NF{print $0 "\n"}'<br />
<br />
# triple space a file<br />
awk '1;{print "\n"}'<br />
<br />
NUMBERING AND CALCULATIONS:<br />
<br />
# precede each line by its line number FOR THAT FILE (left alignment).<br />
# Using a tab (\t) instead of space will preserve margins.<br />
awk '{print FNR "\t" $0}' files*<br />
<br />
# precede each line by its line number FOR ALL FILES TOGETHER, with tab.<br />
awk '{print NR "\t" $0}' files*<br />
<br />
# number each line of a file (number on left, right-aligned)<br />
# Double the percent signs if typing from the DOS command prompt.<br />
awk '{printf("%5d : %s\n", NR,$0)}'<br />
<br />
# number each line of file, but only print numbers if line is not blank<br />
# Remember caveats about Unix treatment of \r (mentioned above)<br />
awk 'NF{$0=++a " :" $0};{print}'<br />
awk '{print (NF? ++a " :" :"") $0}'<br />
<br />
# count lines (emulates "wc -l")<br />
awk 'END{print NR}'<br />
<br />
# print the sums of the fields of every line<br />
awk '{s=0; for (i=1; i<=NF; i++) s=s+$i; print s}'<br />
<br />
# add all fields in all lines and print the sum<br />
awk '{for (i=1; i<=NF; i++) s=s+$i}; END{print s}'<br />
<br />
# print every line after replacing each field with its absolute value<br />
awk '{for (i=1; i<=NF; i++) if ($i < 0) $i = -$i; print }'<br />
awk '{for (i=1; i<=NF; i++) $i = ($i < 0) ? -$i : $i; print }'<br />
<br />
# print the total number of fields ("words") in all lines<br />
awk '{ total = total + NF }; END {print total}' file<br />
<br />
# print the total number of lines that contain "Beth"<br />
awk '/Beth/{n++}; END {print n+0}' file<br />
<br />
# print the largest first field and the line that contains it<br />
# Intended for finding the longest string in field #1<br />
awk '$1 > max {max=$1; maxline=$0}; END{ print max, maxline}'<br />
<br />
# print the number of fields in each line, followed by the line<br />
awk '{ print NF ":" $0 } '<br />
<br />
# print the last field of each line<br />
awk '{ print $NF }'<br />
<br />
# print the last field of the last line<br />
awk '{ field = $NF }; END{ print field }'<br />
<br />
# print every line with more than 4 fields<br />
awk 'NF > 4'<br />
<br />
# print every line where the value of the last field is > 4<br />
awk '$NF > 4'<br />
<br />
<br />
TEXT CONVERSION AND SUBSTITUTION:<br />
<br />
# IN UNIX ENVIRONMENT: convert DOS newlines (CR/LF) to Unix format<br />
awk '{sub(/\r$/,"");print}' # assumes EACH line ends with Ctrl-M<br />
<br />
# IN UNIX ENVIRONMENT: convert Unix newlines (LF) to DOS format<br />
awk '{sub(/$/,"\r");print}<br />
<br />
# IN DOS ENVIRONMENT: convert Unix newlines (LF) to DOS format<br />
awk 1<br />
<br />
# IN DOS ENVIRONMENT: convert DOS newlines (CR/LF) to Unix format<br />
# Cannot be done with DOS versions of awk, other than gawk:<br />
gawk -v BINMODE="w" '1' infile >outfile<br />
<br />
# Use "tr" instead.<br />
tr -d \r <infile >outfile # GNU tr version 1.22 or higher<br />
<br />
# delete leading whitespace (spaces, tabs) from front of each line<br />
# aligns all text flush left<br />
awk '{sub(/^[ \t]+/, ""); print}'<br />
<br />
# delete trailing whitespace (spaces, tabs) from end of each line<br />
awk '{sub(/[ \t]+$/, "");print}'<br />
<br />
# delete BOTH leading and trailing whitespace from each line<br />
awk '{gsub(/^[ \t]+|[ \t]+$/,"");print}'<br />
awk '{$1=$1;print}' # also removes extra space between fields<br />
<br />
# insert 5 blank spaces at beginning of each line (make page offset)<br />
awk '{sub(/^/, " ");print}'<br />
<br />
# align all text flush right on a 79-column width<br />
awk '{printf "%79s\n", $0}' file*<br />
<br />
# center all text on a 79-character width<br />
awk '{l=length();s=int((79-l)/2); printf "%"(s+l)"s\n",$0}' file*<br />
<br />
# substitute (find and replace) "foo" with "bar" on each line<br />
awk '{sub(/foo/,"bar");print}' # replaces only 1st instance<br />
gawk '{$0=gensub(/foo/,"bar",4);print}' # replaces only 4th instance<br />
awk '{gsub(/foo/,"bar");print}' # replaces ALL instances in a line<br />
<br />
# substitute "foo" with "bar" ONLY for lines which contain "baz"<br />
awk '/baz/{gsub(/foo/, "bar")};{print}'<br />
<br />
# substitute "foo" with "bar" EXCEPT for lines which contain "baz"<br />
awk '!/baz/{gsub(/foo/, "bar")};{print}'<br />
<br />
# change "scarlet" or "ruby" or "puce" to "red"<br />
awk '{gsub(/scarlet|ruby|puce/, "red"); print}'<br />
<br />
# reverse order of lines (emulates "tac")<br />
awk '{a[i++]=$0} END {for (j=i-1; j>=0;) print a[j--] }' file*<br />
<br />
# if a line ends with a backslash, append the next line to it<br />
# (fails if there are multiple lines ending with backslash...)<br />
awk '/\\$/ {sub(/\\$/,""); getline t; print $0 t; next}; 1' file*<br />
<br />
# print and sort the login names of all users<br />
awk -F ":" '{ print $1 | "sort" }' /etc/passwd<br />
<br />
# print the first 2 fields, in opposite order, of every line<br />
awk '{print $2, $1}' file<br />
<br />
# switch the first 2 fields of every line<br />
awk '{temp = $1; $1 = $2; $2 = temp}' file<br />
<br />
# print every line, deleting the second field of that line<br />
awk '{ $2 = ""; print }'<br />
<br />
# print in reverse order the fields of every line<br />
awk '{for (i=NF; i>0; i--) printf("%s ",i);printf ("\n")}' file<br />
<br />
# remove duplicate, consecutive lines (emulates "uniq")<br />
awk 'a !~ $0; {a=$0}'<br />
<br />
# remove duplicate, nonconsecutive lines<br />
awk '! a[$0]++' # most concise script<br />
awk '!($0 in a) {a[$0];print}' # most efficient script<br />
<br />
# concatenate every 5 lines of input, using a comma separator<br />
# between fields<br />
awk 'ORS=%NR%5?",":"\n"' file<br />
<br />
<br />
<br />
SELECTIVE PRINTING OF CERTAIN LINES:<br />
<br />
# print first 10 lines of file (emulates behavior of "head")<br />
awk 'NR < 11'<br />
<br />
# print first line of file (emulates "head -1")<br />
awk 'NR>1{exit};1'<br />
<br />
# print the last 2 lines of a file (emulates "tail -2")<br />
awk '{y=x "\n" $0; x=$0};END{print y}'<br />
<br />
# print the last line of a file (emulates "tail -1")<br />
awk 'END{print}'<br />
<br />
# print only lines which match regular expression (emulates "grep")<br />
awk '/regex/'<br />
<br />
# print only lines which do NOT match regex (emulates "grep -v")<br />
awk '!/regex/'<br />
<br />
# print the line immediately before a regex, but not the line<br />
# containing the regex<br />
awk '/regex/{print x};{x=$0}'<br />
awk '/regex/{print (x=="" ? "match on line 1" : x)};{x=$0}'<br />
<br />
# print the line immediately after a regex, but not the line<br />
# containing the regex<br />
awk '/regex/{getline;print}'<br />
<br />
# grep for AAA and BBB and CCC (in any order)<br />
awk '/AAA/; /BBB/; /CCC/'<br />
<br />
# grep for AAA and BBB and CCC (in that order)<br />
awk '/AAA.*BBB.*CCC/'<br />
<br />
# print only lines of 65 characters or longer<br />
awk 'length > 64'<br />
<br />
# print only lines of less than 65 characters<br />
awk 'length < 64'<br />
<br />
# print section of file from regular expression to end of file<br />
awk '/regex/,0'<br />
awk '/regex/,EOF'<br />
<br />
# print section of file based on line numbers (lines 8-12, inclusive)<br />
awk 'NR==8,NR==12'<br />
<br />
# print line number 52<br />
awk 'NR==52'<br />
awk 'NR==52 {print;exit}' # more efficient on large files<br />
<br />
# print section of file between two regular expressions (inclusive)<br />
awk '/Iowa/,/Montana/' # case sensitive<br />
<br />
<br />
SELECTIVE DELETION OF CERTAIN LINES:<br />
<br />
# delete ALL blank lines from a file (same as "grep '.' ")<br />
awk NF<br />
awk '/./'<br />
<br />
<br />
CREDITS AND THANKS:<br />
<br />
Special thanks to Peter S. Tillier for helping me with the first release<br />
of this FAQ file.<br />
<br />
For additional syntax instructions, including the way to apply editing<br />
commands from a disk file instead of the command line, consult:<br />
<br />
"sed & awk, 2nd Edition," by Dale Dougherty and Arnold Robbins<br />
O'Reilly, 1997<br />
"UNIX Text Processing," by Dale Dougherty and Tim O'Reilly<br />
Hayden Books, 1987<br />
"Effective awk Programming, 3rd Edition." by Arnold Robbins<br />
O'Reilly, 2001<br />
<br />
To fully exploit the power of awk, one must understand "regular<br />
expressions." For detailed discussion of regular expressions, see<br />
"Mastering Regular Expressions, 2d edition" by Jeffrey Friedl<br />
(O'Reilly, 2002).<br />
<br />
The manual ("man") pages on Unix systems may be helpful (try "man awk",<br />
"man nawk", "man regexp", or the section on regular expressions in "man<br />
ed"), but man pages are notoriously difficult. They are not written to<br />
teach awk use or regexps to first-time users, but as a reference text<br />
for those already acquainted with these tools.<br />
<br />
USE OF '\t' IN awk SCRIPTS: For clarity in documentation, we have used<br />
the expression '\t' to indicate a tab character (0x09) in the scripts.<br />
All versions of awk, even the UNIX System 7 version should recognize<br />
the '\t' abbreviation.</div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=AWK&diff=95AWK2014-05-13T17:35:42Z<p>Tjmustard: Created page with "===General use:=== AWK can be used to: # grab a specific substring from a larger string # do basic math ==Grabing a substring== ===Handy One Liners=== HANDY ONE-LINERS FOR ..."</p>
<hr />
<div>===General use:===<br />
AWK can be used to:<br />
# grab a specific substring from a larger string<br />
# do basic math<br />
<br />
==Grabing a substring==<br />
<br />
<br />
===Handy One Liners===<br />
HANDY ONE-LINERS FOR AWK 22 July 2003<br />
compiled by Eric Pement <pemente@northpark.edu> version 0.22<br />
Latest version of this file is usually at:<br />
http://www.student.northpark.edu/pemente/awk/awk1line.txt<br />
<br />
<br />
USAGE:<br />
<br />
Unix: awk '/pattern/ {print "$1"}' # standard Unix shells<br />
DOS/Win: awk '/pattern/ {print "$1"}' # okay for DJGPP compiled<br />
awk "/pattern/ {print \"$1\"}" # required for Mingw32<br />
<br />
Most of my experience comes from version of GNU awk (gawk) compiled for<br />
Win32. Note in particular that DJGPP compilations permit the awk script<br />
to follow Unix quoting syntax '/like/ {"this"}'. However, the user must<br />
know that single quotes under DOS/Windows do not protect the redirection<br />
arrows (<, >) nor do they protect pipes (|). Both are special symbols<br />
for the DOS/CMD command shell and their special meaning is ignored only<br />
if they are placed within "double quotes." Likewise, DOS/Win users must<br />
remember that the percent sign (%) is used to mark DOS/Win environment<br />
variables, so it must be doubled (%%) to yield a single percent sign<br />
visible to awk.<br />
<br />
If I am sure that a script will NOT need to be quoted in Unix, DOS, or<br />
CMD, then I normally omit the quote marks. If an example is peculiar to<br />
GNU awk, the command 'gawk' will be used. Please notify me if you find<br />
errors or new commands to add to this list (total length under 65<br />
characters). I usually try to put the shortest script first.<br />
<br />
FILE SPACING:<br />
<br />
# double space a file<br />
awk '1;{print ""}'<br />
awk 'BEGIN{ORS="\n\n"};1'<br />
<br />
# double space a file which already has blank lines in it. Output file<br />
# should contain no more than one blank line between lines of text.<br />
# NOTE: On Unix systems, DOS lines which have only CRLF (\r\n) are<br />
# often treated as non-blank, and thus 'NF' alone will return TRUE.<br />
awk 'NF{print $0 "\n"}'<br />
<br />
# triple space a file<br />
awk '1;{print "\n"}'<br />
<br />
NUMBERING AND CALCULATIONS:<br />
<br />
# precede each line by its line number FOR THAT FILE (left alignment).<br />
# Using a tab (\t) instead of space will preserve margins.<br />
awk '{print FNR "\t" $0}' files*<br />
<br />
# precede each line by its line number FOR ALL FILES TOGETHER, with tab.<br />
awk '{print NR "\t" $0}' files*<br />
<br />
# number each line of a file (number on left, right-aligned)<br />
# Double the percent signs if typing from the DOS command prompt.<br />
awk '{printf("%5d : %s\n", NR,$0)}'<br />
<br />
# number each line of file, but only print numbers if line is not blank<br />
# Remember caveats about Unix treatment of \r (mentioned above)<br />
awk 'NF{$0=++a " :" $0};{print}'<br />
awk '{print (NF? ++a " :" :"") $0}'<br />
<br />
# count lines (emulates "wc -l")<br />
awk 'END{print NR}'<br />
<br />
# print the sums of the fields of every line<br />
awk '{s=0; for (i=1; i<=NF; i++) s=s+$i; print s}'<br />
<br />
# add all fields in all lines and print the sum<br />
awk '{for (i=1; i<=NF; i++) s=s+$i}; END{print s}'<br />
<br />
# print every line after replacing each field with its absolute value<br />
awk '{for (i=1; i<=NF; i++) if ($i < 0) $i = -$i; print }'<br />
awk '{for (i=1; i<=NF; i++) $i = ($i < 0) ? -$i : $i; print }'<br />
<br />
# print the total number of fields ("words") in all lines<br />
awk '{ total = total + NF }; END {print total}' file<br />
<br />
# print the total number of lines that contain "Beth"<br />
awk '/Beth/{n++}; END {print n+0}' file<br />
<br />
# print the largest first field and the line that contains it<br />
# Intended for finding the longest string in field #1<br />
awk '$1 > max {max=$1; maxline=$0}; END{ print max, maxline}'<br />
<br />
# print the number of fields in each line, followed by the line<br />
awk '{ print NF ":" $0 } '<br />
<br />
# print the last field of each line<br />
awk '{ print $NF }'<br />
<br />
# print the last field of the last line<br />
awk '{ field = $NF }; END{ print field }'<br />
<br />
# print every line with more than 4 fields<br />
awk 'NF > 4'<br />
<br />
# print every line where the value of the last field is > 4<br />
awk '$NF > 4'<br />
<br />
<br />
TEXT CONVERSION AND SUBSTITUTION:<br />
<br />
# IN UNIX ENVIRONMENT: convert DOS newlines (CR/LF) to Unix format<br />
awk '{sub(/\r$/,"");print}' # assumes EACH line ends with Ctrl-M<br />
<br />
# IN UNIX ENVIRONMENT: convert Unix newlines (LF) to DOS format<br />
awk '{sub(/$/,"\r");print}<br />
<br />
# IN DOS ENVIRONMENT: convert Unix newlines (LF) to DOS format<br />
awk 1<br />
<br />
# IN DOS ENVIRONMENT: convert DOS newlines (CR/LF) to Unix format<br />
# Cannot be done with DOS versions of awk, other than gawk:<br />
gawk -v BINMODE="w" '1' infile >outfile<br />
<br />
# Use "tr" instead.<br />
tr -d \r <infile >outfile # GNU tr version 1.22 or higher<br />
<br />
# delete leading whitespace (spaces, tabs) from front of each line<br />
# aligns all text flush left<br />
awk '{sub(/^[ \t]+/, ""); print}'<br />
<br />
# delete trailing whitespace (spaces, tabs) from end of each line<br />
awk '{sub(/[ \t]+$/, "");print}'<br />
<br />
# delete BOTH leading and trailing whitespace from each line<br />
awk '{gsub(/^[ \t]+|[ \t]+$/,"");print}'<br />
awk '{$1=$1;print}' # also removes extra space between fields<br />
<br />
# insert 5 blank spaces at beginning of each line (make page offset)<br />
awk '{sub(/^/, " ");print}'<br />
<br />
# align all text flush right on a 79-column width<br />
awk '{printf "%79s\n", $0}' file*<br />
<br />
# center all text on a 79-character width<br />
awk '{l=length();s=int((79-l)/2); printf "%"(s+l)"s\n",$0}' file*<br />
<br />
# substitute (find and replace) "foo" with "bar" on each line<br />
awk '{sub(/foo/,"bar");print}' # replaces only 1st instance<br />
gawk '{$0=gensub(/foo/,"bar",4);print}' # replaces only 4th instance<br />
awk '{gsub(/foo/,"bar");print}' # replaces ALL instances in a line<br />
<br />
# substitute "foo" with "bar" ONLY for lines which contain "baz"<br />
awk '/baz/{gsub(/foo/, "bar")};{print}'<br />
<br />
# substitute "foo" with "bar" EXCEPT for lines which contain "baz"<br />
awk '!/baz/{gsub(/foo/, "bar")};{print}'<br />
<br />
# change "scarlet" or "ruby" or "puce" to "red"<br />
awk '{gsub(/scarlet|ruby|puce/, "red"); print}'<br />
<br />
# reverse order of lines (emulates "tac")<br />
awk '{a[i++]=$0} END {for (j=i-1; j>=0;) print a[j--] }' file*<br />
<br />
# if a line ends with a backslash, append the next line to it<br />
# (fails if there are multiple lines ending with backslash...)<br />
awk '/\\$/ {sub(/\\$/,""); getline t; print $0 t; next}; 1' file*<br />
<br />
# print and sort the login names of all users<br />
awk -F ":" '{ print $1 | "sort" }' /etc/passwd<br />
<br />
# print the first 2 fields, in opposite order, of every line<br />
awk '{print $2, $1}' file<br />
<br />
# switch the first 2 fields of every line<br />
awk '{temp = $1; $1 = $2; $2 = temp}' file<br />
<br />
# print every line, deleting the second field of that line<br />
awk '{ $2 = ""; print }'<br />
<br />
# print in reverse order the fields of every line<br />
awk '{for (i=NF; i>0; i--) printf("%s ",i);printf ("\n")}' file<br />
<br />
# remove duplicate, consecutive lines (emulates "uniq")<br />
awk 'a !~ $0; {a=$0}'<br />
<br />
# remove duplicate, nonconsecutive lines<br />
awk '! a[$0]++' # most concise script<br />
awk '!($0 in a) {a[$0];print}' # most efficient script<br />
<br />
# concatenate every 5 lines of input, using a comma separator<br />
# between fields<br />
awk 'ORS=%NR%5?",":"\n"' file<br />
<br />
<br />
<br />
SELECTIVE PRINTING OF CERTAIN LINES:<br />
<br />
# print first 10 lines of file (emulates behavior of "head")<br />
awk 'NR < 11'<br />
<br />
# print first line of file (emulates "head -1")<br />
awk 'NR>1{exit};1'<br />
<br />
# print the last 2 lines of a file (emulates "tail -2")<br />
awk '{y=x "\n" $0; x=$0};END{print y}'<br />
<br />
# print the last line of a file (emulates "tail -1")<br />
awk 'END{print}'<br />
<br />
# print only lines which match regular expression (emulates "grep")<br />
awk '/regex/'<br />
<br />
# print only lines which do NOT match regex (emulates "grep -v")<br />
awk '!/regex/'<br />
<br />
# print the line immediately before a regex, but not the line<br />
# containing the regex<br />
awk '/regex/{print x};{x=$0}'<br />
awk '/regex/{print (x=="" ? "match on line 1" : x)};{x=$0}'<br />
<br />
# print the line immediately after a regex, but not the line<br />
# containing the regex<br />
awk '/regex/{getline;print}'<br />
<br />
# grep for AAA and BBB and CCC (in any order)<br />
awk '/AAA/; /BBB/; /CCC/'<br />
<br />
# grep for AAA and BBB and CCC (in that order)<br />
awk '/AAA.*BBB.*CCC/'<br />
<br />
# print only lines of 65 characters or longer<br />
awk 'length > 64'<br />
<br />
# print only lines of less than 65 characters<br />
awk 'length < 64'<br />
<br />
# print section of file from regular expression to end of file<br />
awk '/regex/,0'<br />
awk '/regex/,EOF'<br />
<br />
# print section of file based on line numbers (lines 8-12, inclusive)<br />
awk 'NR==8,NR==12'<br />
<br />
# print line number 52<br />
awk 'NR==52'<br />
awk 'NR==52 {print;exit}' # more efficient on large files<br />
<br />
# print section of file between two regular expressions (inclusive)<br />
awk '/Iowa/,/Montana/' # case sensitive<br />
<br />
<br />
SELECTIVE DELETION OF CERTAIN LINES:<br />
<br />
# delete ALL blank lines from a file (same as "grep '.' ")<br />
awk NF<br />
awk '/./'<br />
<br />
<br />
CREDITS AND THANKS:<br />
<br />
Special thanks to Peter S. Tillier for helping me with the first release<br />
of this FAQ file.<br />
<br />
For additional syntax instructions, including the way to apply editing<br />
commands from a disk file instead of the command line, consult:<br />
<br />
"sed & awk, 2nd Edition," by Dale Dougherty and Arnold Robbins<br />
O'Reilly, 1997<br />
"UNIX Text Processing," by Dale Dougherty and Tim O'Reilly<br />
Hayden Books, 1987<br />
"Effective awk Programming, 3rd Edition." by Arnold Robbins<br />
O'Reilly, 2001<br />
<br />
To fully exploit the power of awk, one must understand "regular<br />
expressions." For detailed discussion of regular expressions, see<br />
"Mastering Regular Expressions, 2d edition" by Jeffrey Friedl<br />
(O'Reilly, 2002).<br />
<br />
The manual ("man") pages on Unix systems may be helpful (try "man awk",<br />
"man nawk", "man regexp", or the section on regular expressions in "man<br />
ed"), but man pages are notoriously difficult. They are not written to<br />
teach awk use or regexps to first-time users, but as a reference text<br />
for those already acquainted with these tools.<br />
<br />
USE OF '\t' IN awk SCRIPTS: For clarity in documentation, we have used<br />
the expression '\t' to indicate a tab character (0x09) in the scripts.<br />
All versions of awk, even the UNIX System 7 version should recognize<br />
the '\t' abbreviation.</div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=Linux_Related&diff=91Linux Related2014-05-13T17:33:43Z<p>Tjmustard: /* Linux Programs */</p>
<hr />
<div>===General Commands===<br />
<br />
<br />
<br />
===Linux Programs===<br />
[[VIM]]<br />
[[SED]]<br />
[[AWK]]</div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=Linux_Related&diff=88Linux Related2014-05-13T17:32:24Z<p>Tjmustard: Created page with "===General Commands=== ===Linux Programs==="</p>
<hr />
<div>===General Commands===<br />
<br />
<br />
<br />
===Linux Programs===</div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=Main_Page&diff=86Main Page2014-05-13T17:08:38Z<p>Tjmustard: /* Public Resources */</p>
<hr />
<div><br />
===General===<br />
----<br />
* [[Group News]]<br />
<br />
* [[About PHYC]]<br />
<br />
* [[General Research in the PHYC Group]]<br />
<br />
* [[Collaborators]]<br />
<br />
* [http://phyc.chem.oregonstate.edu/publications Publications]<br />
<br />
===Software Related===<br />
----<br />
* [[Apple Related]]<br />
<br />
* [[Linux Related]]<br />
<br />
* [[Text Editors]]<br />
<br />
* [[Computational Software Related]]<br />
<br />
* [[Computational Software Manuals]]<br />
<br />
* [[Ad Hoc Script Collection]]<br />
<br />
* [[Strange Error Messages]]<br />
<br />
<br />
===Resources===<br />
----<br />
* [[Woodward]]<br />
<br />
* [[Fermi]]<br />
<br />
<br />
===Programming===<br />
----<br />
<br />
* [[BASH]]<br />
<br />
* [[Python]]<br />
<br />
* [[C++]]<br />
<br />
<br />
===Links===<br />
----<br />
* [[Chemistry Journals]]<br />
<br />
* [[Computational Chemistry]]<br />
<br />
* [[Organic Chemistry News, Highlights and Blogs]]<br />
<br />
* [[Other Links]]<br />
<br />
===Public Resources===<br />
----<br />
[[Publics:Public Test Page]]<br />
<br />
== Getting started ==<br />
* [//www.mediawiki.org/wiki/Manual:Configuration_settings Configuration settings list]<br />
* [//www.mediawiki.org/wiki/Manual:FAQ MediaWiki FAQ]<br />
* [https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]<br />
* [//www.mediawiki.org/wiki/Localisation#Translation_resources Localise MediaWiki for your language]<br />
<br />
Consult the [//meta.wikimedia.org/wiki/Help:Contents User's Guide] for information on using the wiki software.</div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=Public_Test_Page&diff=84Public Test Page2014-05-13T17:03:55Z<p>Tjmustard: </p>
<hr />
<div>Public test page<br />
<br />
[[Category:Public]]</div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=Public_Test_Page&diff=82Public Test Page2014-05-13T17:03:28Z<p>Tjmustard: Created page with "Public test page Category:Publics"</p>
<hr />
<div>Public test page<br />
<br />
[[Category:Publics]]</div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=Main_Page&diff=80Main Page2014-05-13T17:02:55Z<p>Tjmustard: /* Public Resources */</p>
<hr />
<div><br />
===General===<br />
----<br />
* [[Group News]]<br />
<br />
* [[About PHYC]]<br />
<br />
* [[General Research in the PHYC Group]]<br />
<br />
* [[Collaborators]]<br />
<br />
* [http://phyc.chem.oregonstate.edu/publications Publications]<br />
<br />
===Software Related===<br />
----<br />
* [[Apple Related]]<br />
<br />
* [[Linux Related]]<br />
<br />
* [[Text Editors]]<br />
<br />
* [[Computational Software Related]]<br />
<br />
* [[Computational Software Manuals]]<br />
<br />
* [[Ad Hoc Script Collection]]<br />
<br />
* [[Strange Error Messages]]<br />
<br />
<br />
===Resources===<br />
----<br />
* [[Woodward]]<br />
<br />
* [[Fermi]]<br />
<br />
<br />
===Programming===<br />
----<br />
<br />
* [[BASH]]<br />
<br />
* [[Python]]<br />
<br />
* [[C++]]<br />
<br />
<br />
===Links===<br />
----<br />
* [[Chemistry Journals]]<br />
<br />
* [[Computational Chemistry]]<br />
<br />
* [[Organic Chemistry News, Highlights and Blogs]]<br />
<br />
* [[Other Links]]<br />
<br />
===Public Resources===<br />
----<br />
[[Public Test Page]]<br />
<br />
== Getting started ==<br />
* [//www.mediawiki.org/wiki/Manual:Configuration_settings Configuration settings list]<br />
* [//www.mediawiki.org/wiki/Manual:FAQ MediaWiki FAQ]<br />
* [https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]<br />
* [//www.mediawiki.org/wiki/Localisation#Translation_resources Localise MediaWiki for your language]<br />
<br />
Consult the [//meta.wikimedia.org/wiki/Help:Contents User's Guide] for information on using the wiki software.</div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=Public:Group_News&diff=78Public:Group News2014-05-13T17:02:03Z<p>Tjmustard: </p>
<hr />
<div>==2011.08.15 - Cluster==<br />
The test GPU node is tested with QM program! Whopping performance!!!<br />
<br />
==2011.06.15 - Cluster==<br />
The test GPU node is constructed and tested with GROMACS.<br />
<br />
==2011.01.05 - Cluster==<br />
The second generation expansion of the Woodward cluster just added, tripling our core count!<br />
<br />
<br />
==2010.11.08 - Arrival==<br />
Postdoc I-Ya Chang arrived from Taiwan!<br />
<br />
<br />
==2010.11.04 - Software==<br />
Q-Chem 3.2 license extended to 2011.<br />
<br />
<br />
==2010.09.12 - Software==<br />
OSU TRF funding for Gaussian09 and GaussView5 approved!<br />
OSU TRF Funding for 3 more years of ChemDrawUltra approved!<br />
<br />
<br />
==2010.07.23 - Cluster==<br />
The Borg cluster goes up, thanks to TJ!<br />
<br />
<br />
==2010.07.05 - Group member(s)==<br />
TJ Mustard and George Burgess have joined the lab as graduate students!<br />
<br />
<br />
==2010.05.15 - Software==<br />
PHYC, Chemistry and Pharmacy agrees on a deal to pay for first year license of ChemDrawUltra for all of OSU!<br />
<br />
<br />
==2010.02.05 - Group member(s)==<br />
Nilobon Pattawong and Matthew Pierce has joined the lab as graduate student!<br />
<br />
<br />
==2009.10.08 - Group member(s)==<br />
Subham Mahaptra has joined the lab as joint graduate student with Professor Rich Carter!<br />
<br />
<br />
==2009 09 27 - Software==<br />
Openeye, VCONF, and Babel installed and configured on Woodward!<br />
<br />
<br />
==2009 09 25 - Queue==<br />
Parallel queues (SMP, MPI) implemented on Woodward!<br />
<br />
<br />
==2009 09 24 - Software==<br />
Gaussian, Q-Chem, NWChem, NAMD, and GROMACS installed and configured on Woodward!<br />
<br />
<br />
==2009 09 22 - Cluster==<br />
Cluster status now available online!<br />
<br />
<br />
==2009 09 21 - Cluster==<br />
The Woodward cluster has arrived! Many thanks to friends from Silicon Mechanics (Art Mann and Scott Humphreys).<br />
<br />
<br />
==2009 08 15 - Coworker==<br />
Dr. I-Ya Chang has decided to join the lab as postdoc!<br />
<br />
<br />
==2009 05 13 - Awards==<br />
PHYC wins the Boyer-AMGEN postdoctoral award!<br />
<br />
[[Category:Publics]]</div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=Main_Page&diff=76Main Page2014-05-13T17:00:53Z<p>Tjmustard: /* Public Resources */</p>
<hr />
<div><br />
===General===<br />
----<br />
* [[Group News]]<br />
<br />
* [[About PHYC]]<br />
<br />
* [[General Research in the PHYC Group]]<br />
<br />
* [[Collaborators]]<br />
<br />
* [http://phyc.chem.oregonstate.edu/publications Publications]<br />
<br />
===Software Related===<br />
----<br />
* [[Apple Related]]<br />
<br />
* [[Linux Related]]<br />
<br />
* [[Text Editors]]<br />
<br />
* [[Computational Software Related]]<br />
<br />
* [[Computational Software Manuals]]<br />
<br />
* [[Ad Hoc Script Collection]]<br />
<br />
* [[Strange Error Messages]]<br />
<br />
<br />
===Resources===<br />
----<br />
* [[Woodward]]<br />
<br />
* [[Fermi]]<br />
<br />
<br />
===Programming===<br />
----<br />
<br />
* [[BASH]]<br />
<br />
* [[Python]]<br />
<br />
* [[C++]]<br />
<br />
<br />
===Links===<br />
----<br />
* [[Chemistry Journals]]<br />
<br />
* [[Computational Chemistry]]<br />
<br />
* [[Organic Chemistry News, Highlights and Blogs]]<br />
<br />
* [[Other Links]]<br />
<br />
===Public Resources===<br />
----<br />
[[Category:Publics|Test Page1]]<br />
[[:Category:Publics|Test Page]]<br />
<br />
== Getting started ==<br />
* [//www.mediawiki.org/wiki/Manual:Configuration_settings Configuration settings list]<br />
* [//www.mediawiki.org/wiki/Manual:FAQ MediaWiki FAQ]<br />
* [https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]<br />
* [//www.mediawiki.org/wiki/Localisation#Translation_resources Localise MediaWiki for your language]<br />
<br />
Consult the [//meta.wikimedia.org/wiki/Help:Contents User's Guide] for information on using the wiki software.</div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=Main_Page&diff=73Main Page2014-05-13T17:00:32Z<p>Tjmustard: /* Public Resources */</p>
<hr />
<div><br />
===General===<br />
----<br />
* [[Group News]]<br />
<br />
* [[About PHYC]]<br />
<br />
* [[General Research in the PHYC Group]]<br />
<br />
* [[Collaborators]]<br />
<br />
* [http://phyc.chem.oregonstate.edu/publications Publications]<br />
<br />
===Software Related===<br />
----<br />
* [[Apple Related]]<br />
<br />
* [[Linux Related]]<br />
<br />
* [[Text Editors]]<br />
<br />
* [[Computational Software Related]]<br />
<br />
* [[Computational Software Manuals]]<br />
<br />
* [[Ad Hoc Script Collection]]<br />
<br />
* [[Strange Error Messages]]<br />
<br />
<br />
===Resources===<br />
----<br />
* [[Woodward]]<br />
<br />
* [[Fermi]]<br />
<br />
<br />
===Programming===<br />
----<br />
<br />
* [[BASH]]<br />
<br />
* [[Python]]<br />
<br />
* [[C++]]<br />
<br />
<br />
===Links===<br />
----<br />
* [[Chemistry Journals]]<br />
<br />
* [[Computational Chemistry]]<br />
<br />
* [[Organic Chemistry News, Highlights and Blogs]]<br />
<br />
* [[Other Links]]<br />
<br />
===Public Resources===<br />
----<br />
[[Category:Publics|Test Page]]<br />
[[:Category:Publics|Test Page]]<br />
<br />
== Getting started ==<br />
* [//www.mediawiki.org/wiki/Manual:Configuration_settings Configuration settings list]<br />
* [//www.mediawiki.org/wiki/Manual:FAQ MediaWiki FAQ]<br />
* [https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]<br />
* [//www.mediawiki.org/wiki/Localisation#Translation_resources Localise MediaWiki for your language]<br />
<br />
Consult the [//meta.wikimedia.org/wiki/Help:Contents User's Guide] for information on using the wiki software.</div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=Category:Publics&diff=71Category:Publics2014-05-13T16:59:22Z<p>Tjmustard: Created page with "This is a test page with some text on it."</p>
<hr />
<div>This is a test page with some text on it.</div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=Main_Page&diff=68Main Page2014-05-13T16:58:59Z<p>Tjmustard: /* Public Resources */</p>
<hr />
<div><br />
===General===<br />
----<br />
* [[Group News]]<br />
<br />
* [[About PHYC]]<br />
<br />
* [[General Research in the PHYC Group]]<br />
<br />
* [[Collaborators]]<br />
<br />
* [http://phyc.chem.oregonstate.edu/publications Publications]<br />
<br />
===Software Related===<br />
----<br />
* [[Apple Related]]<br />
<br />
* [[Linux Related]]<br />
<br />
* [[Text Editors]]<br />
<br />
* [[Computational Software Related]]<br />
<br />
* [[Computational Software Manuals]]<br />
<br />
* [[Ad Hoc Script Collection]]<br />
<br />
* [[Strange Error Messages]]<br />
<br />
<br />
===Resources===<br />
----<br />
* [[Woodward]]<br />
<br />
* [[Fermi]]<br />
<br />
<br />
===Programming===<br />
----<br />
<br />
* [[BASH]]<br />
<br />
* [[Python]]<br />
<br />
* [[C++]]<br />
<br />
<br />
===Links===<br />
----<br />
* [[Chemistry Journals]]<br />
<br />
* [[Computational Chemistry]]<br />
<br />
* [[Organic Chemistry News, Highlights and Blogs]]<br />
<br />
* [[Other Links]]<br />
<br />
===Public Resources===<br />
----<br />
[[Publics:Test Page]]<br />
[[:Category:Publics|Test Page]]<br />
<br />
== Getting started ==<br />
* [//www.mediawiki.org/wiki/Manual:Configuration_settings Configuration settings list]<br />
* [//www.mediawiki.org/wiki/Manual:FAQ MediaWiki FAQ]<br />
* [https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]<br />
* [//www.mediawiki.org/wiki/Localisation#Translation_resources Localise MediaWiki for your language]<br />
<br />
Consult the [//meta.wikimedia.org/wiki/Help:Contents User's Guide] for information on using the wiki software.</div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=Main_Page&diff=66Main Page2014-05-13T16:58:23Z<p>Tjmustard: /* Public Resources */</p>
<hr />
<div><br />
===General===<br />
----<br />
* [[Group News]]<br />
<br />
* [[About PHYC]]<br />
<br />
* [[General Research in the PHYC Group]]<br />
<br />
* [[Collaborators]]<br />
<br />
* [http://phyc.chem.oregonstate.edu/publications Publications]<br />
<br />
===Software Related===<br />
----<br />
* [[Apple Related]]<br />
<br />
* [[Linux Related]]<br />
<br />
* [[Text Editors]]<br />
<br />
* [[Computational Software Related]]<br />
<br />
* [[Computational Software Manuals]]<br />
<br />
* [[Ad Hoc Script Collection]]<br />
<br />
* [[Strange Error Messages]]<br />
<br />
<br />
===Resources===<br />
----<br />
* [[Woodward]]<br />
<br />
* [[Fermi]]<br />
<br />
<br />
===Programming===<br />
----<br />
<br />
* [[BASH]]<br />
<br />
* [[Python]]<br />
<br />
* [[C++]]<br />
<br />
<br />
===Links===<br />
----<br />
* [[Chemistry Journals]]<br />
<br />
* [[Computational Chemistry]]<br />
<br />
* [[Organic Chemistry News, Highlights and Blogs]]<br />
<br />
* [[Other Links]]<br />
<br />
===Public Resources===<br />
----<br />
[[Publics:Test Page]]<br />
[[Category:Publics]]<br />
<br />
== Getting started ==<br />
* [//www.mediawiki.org/wiki/Manual:Configuration_settings Configuration settings list]<br />
* [//www.mediawiki.org/wiki/Manual:FAQ MediaWiki FAQ]<br />
* [https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]<br />
* [//www.mediawiki.org/wiki/Localisation#Translation_resources Localise MediaWiki for your language]<br />
<br />
Consult the [//meta.wikimedia.org/wiki/Help:Contents User's Guide] for information on using the wiki software.</div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=Main_Page&diff=64Main Page2014-05-13T16:57:59Z<p>Tjmustard: /* Public Resources */</p>
<hr />
<div><br />
===General===<br />
----<br />
* [[Group News]]<br />
<br />
* [[About PHYC]]<br />
<br />
* [[General Research in the PHYC Group]]<br />
<br />
* [[Collaborators]]<br />
<br />
* [http://phyc.chem.oregonstate.edu/publications Publications]<br />
<br />
===Software Related===<br />
----<br />
* [[Apple Related]]<br />
<br />
* [[Linux Related]]<br />
<br />
* [[Text Editors]]<br />
<br />
* [[Computational Software Related]]<br />
<br />
* [[Computational Software Manuals]]<br />
<br />
* [[Ad Hoc Script Collection]]<br />
<br />
* [[Strange Error Messages]]<br />
<br />
<br />
===Resources===<br />
----<br />
* [[Woodward]]<br />
<br />
* [[Fermi]]<br />
<br />
<br />
===Programming===<br />
----<br />
<br />
* [[BASH]]<br />
<br />
* [[Python]]<br />
<br />
* [[C++]]<br />
<br />
<br />
===Links===<br />
----<br />
* [[Chemistry Journals]]<br />
<br />
* [[Computational Chemistry]]<br />
<br />
* [[Organic Chemistry News, Highlights and Blogs]]<br />
<br />
* [[Other Links]]<br />
<br />
===Public Resources===<br />
----<br />
[[Publics:Test Page]]<br />
[[Category:Publics|Test Page]]<br />
<br />
== Getting started ==<br />
* [//www.mediawiki.org/wiki/Manual:Configuration_settings Configuration settings list]<br />
* [//www.mediawiki.org/wiki/Manual:FAQ MediaWiki FAQ]<br />
* [https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]<br />
* [//www.mediawiki.org/wiki/Localisation#Translation_resources Localise MediaWiki for your language]<br />
<br />
Consult the [//meta.wikimedia.org/wiki/Help:Contents User's Guide] for information on using the wiki software.</div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=Public:Test_Page&diff=63Public:Test Page2014-05-13T16:52:44Z<p>Tjmustard: Created page with "This is a completely public page. For testing purposes."</p>
<hr />
<div>This is a completely public page.<br />
<br />
For testing purposes.</div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=Main_Page&diff=61Main Page2014-05-13T16:52:20Z<p>Tjmustard: </p>
<hr />
<div><br />
===General===<br />
----<br />
* [[Group News]]<br />
<br />
* [[About PHYC]]<br />
<br />
* [[General Research in the PHYC Group]]<br />
<br />
* [[Collaborators]]<br />
<br />
* [http://phyc.chem.oregonstate.edu/publications Publications]<br />
<br />
===Software Related===<br />
----<br />
* [[Apple Related]]<br />
<br />
* [[Linux Related]]<br />
<br />
* [[Text Editors]]<br />
<br />
* [[Computational Software Related]]<br />
<br />
* [[Computational Software Manuals]]<br />
<br />
* [[Ad Hoc Script Collection]]<br />
<br />
* [[Strange Error Messages]]<br />
<br />
<br />
===Resources===<br />
----<br />
* [[Woodward]]<br />
<br />
* [[Fermi]]<br />
<br />
<br />
===Programming===<br />
----<br />
<br />
* [[BASH]]<br />
<br />
* [[Python]]<br />
<br />
* [[C++]]<br />
<br />
<br />
===Links===<br />
----<br />
* [[Chemistry Journals]]<br />
<br />
* [[Computational Chemistry]]<br />
<br />
* [[Organic Chemistry News, Highlights and Blogs]]<br />
<br />
* [[Other Links]]<br />
<br />
===Public Resources===<br />
----<br />
[[Publics:Test Page]]<br />
<br />
<br />
== Getting started ==<br />
* [//www.mediawiki.org/wiki/Manual:Configuration_settings Configuration settings list]<br />
* [//www.mediawiki.org/wiki/Manual:FAQ MediaWiki FAQ]<br />
* [https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]<br />
* [//www.mediawiki.org/wiki/Localisation#Translation_resources Localise MediaWiki for your language]<br />
<br />
Consult the [//meta.wikimedia.org/wiki/Help:Contents User's Guide] for information on using the wiki software.</div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=Main_Page&diff=60Main Page2014-05-13T16:51:19Z<p>Tjmustard: </p>
<hr />
<div><br />
===General===<br />
----<br />
* [[Group News]]<br />
<br />
* [[About PHYC]]<br />
<br />
* [[General Research in the PHYC Group]]<br />
<br />
* [[Collaborators]]<br />
<br />
* [http://phyc.chem.oregonstate.edu/publications Publications]<br />
<br />
===Software Related===<br />
----<br />
* [[Apple Related]]<br />
<br />
* [[Linux Related]]<br />
<br />
* [[Text Editors]]<br />
<br />
* [[Computational Software Related]]<br />
<br />
* [[Computational Software Manuals]]<br />
<br />
* [[Ad Hoc Script Collection]]<br />
<br />
* [[Strange Error Messages]]<br />
<br />
<br />
===Resources===<br />
----<br />
* [[Woodward]]<br />
<br />
* [[Fermi]]<br />
<br />
<br />
===Programming===<br />
----<br />
<br />
* [[BASH]]<br />
<br />
* [[Python]]<br />
<br />
* [[C++]]<br />
<br />
<br />
===Links===<br />
----<br />
* [[Chemistry Journals]]<br />
<br />
* [[Computational Chemistry]]<br />
<br />
* [[Organic Chemistry News, Highlights and Blogs]]<br />
<br />
* [[Other Links]]<br />
<br />
<br />
== Getting started ==<br />
* [//www.mediawiki.org/wiki/Manual:Configuration_settings Configuration settings list]<br />
* [//www.mediawiki.org/wiki/Manual:FAQ MediaWiki FAQ]<br />
* [https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]<br />
* [//www.mediawiki.org/wiki/Localisation#Translation_resources Localise MediaWiki for your language]<br />
<br />
Consult the [//meta.wikimedia.org/wiki/Help:Contents User's Guide] for information on using the wiki software.</div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=Main_Page&diff=58Main Page2014-05-13T16:51:00Z<p>Tjmustard: /* General */</p>
<hr />
<div><br />
[[Publics:Public Test Page]]<br />
<br />
===General===<br />
----<br />
* [[Group News]]<br />
<br />
* [[About PHYC]]<br />
<br />
* [[General Research in the PHYC Group]]<br />
<br />
* [[Collaborators]]<br />
<br />
* [http://phyc.chem.oregonstate.edu/publications Publications]<br />
<br />
===Software Related===<br />
----<br />
* [[Apple Related]]<br />
<br />
* [[Linux Related]]<br />
<br />
* [[Text Editors]]<br />
<br />
* [[Computational Software Related]]<br />
<br />
* [[Computational Software Manuals]]<br />
<br />
* [[Ad Hoc Script Collection]]<br />
<br />
* [[Strange Error Messages]]<br />
<br />
<br />
===Resources===<br />
----<br />
* [[Woodward]]<br />
<br />
* [[Fermi]]<br />
<br />
<br />
===Programming===<br />
----<br />
<br />
* [[BASH]]<br />
<br />
* [[Python]]<br />
<br />
* [[C++]]<br />
<br />
<br />
===Links===<br />
----<br />
* [[Chemistry Journals]]<br />
<br />
* [[Computational Chemistry]]<br />
<br />
* [[Organic Chemistry News, Highlights and Blogs]]<br />
<br />
* [[Other Links]]<br />
<br />
<br />
== Getting started ==<br />
* [//www.mediawiki.org/wiki/Manual:Configuration_settings Configuration settings list]<br />
* [//www.mediawiki.org/wiki/Manual:FAQ MediaWiki FAQ]<br />
* [https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]<br />
* [//www.mediawiki.org/wiki/Localisation#Translation_resources Localise MediaWiki for your language]<br />
<br />
Consult the [//meta.wikimedia.org/wiki/Help:Contents User's Guide] for information on using the wiki software.</div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=Main_Page&diff=55Main Page2014-05-13T16:50:10Z<p>Tjmustard: /* General */</p>
<hr />
<div><br />
[[Publics:Public Test Page]]<br />
<br />
===General===<br />
----<br />
* [[Publics:Group News]]<br />
<br />
* [[About PHYC]]<br />
<br />
* [[General Research in the PHYC Group]]<br />
<br />
* [[Collaborators]]<br />
<br />
* [http://phyc.chem.oregonstate.edu/publications Publications]<br />
<br />
===Software Related===<br />
----<br />
* [[Apple Related]]<br />
<br />
* [[Linux Related]]<br />
<br />
* [[Text Editors]]<br />
<br />
* [[Computational Software Related]]<br />
<br />
* [[Computational Software Manuals]]<br />
<br />
* [[Ad Hoc Script Collection]]<br />
<br />
* [[Strange Error Messages]]<br />
<br />
<br />
===Resources===<br />
----<br />
* [[Woodward]]<br />
<br />
* [[Fermi]]<br />
<br />
<br />
===Programming===<br />
----<br />
<br />
* [[BASH]]<br />
<br />
* [[Python]]<br />
<br />
* [[C++]]<br />
<br />
<br />
===Links===<br />
----<br />
* [[Chemistry Journals]]<br />
<br />
* [[Computational Chemistry]]<br />
<br />
* [[Organic Chemistry News, Highlights and Blogs]]<br />
<br />
* [[Other Links]]<br />
<br />
<br />
== Getting started ==<br />
* [//www.mediawiki.org/wiki/Manual:Configuration_settings Configuration settings list]<br />
* [//www.mediawiki.org/wiki/Manual:FAQ MediaWiki FAQ]<br />
* [https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]<br />
* [//www.mediawiki.org/wiki/Localisation#Translation_resources Localise MediaWiki for your language]<br />
<br />
Consult the [//meta.wikimedia.org/wiki/Help:Contents User's Guide] for information on using the wiki software.</div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=Main_Page&diff=52Main Page2014-05-13T16:49:02Z<p>Tjmustard: </p>
<hr />
<div><br />
[[Publics:Public Test Page]]<br />
<br />
===General===<br />
----<br />
* [[Group News]]<br />
<br />
* [[About PHYC]]<br />
<br />
* [[General Research in the PHYC Group]]<br />
<br />
* [[Collaborators]]<br />
<br />
* [http://phyc.chem.oregonstate.edu/publications Publications]<br />
<br />
<br />
===Software Related===<br />
----<br />
* [[Apple Related]]<br />
<br />
* [[Linux Related]]<br />
<br />
* [[Text Editors]]<br />
<br />
* [[Computational Software Related]]<br />
<br />
* [[Computational Software Manuals]]<br />
<br />
* [[Ad Hoc Script Collection]]<br />
<br />
* [[Strange Error Messages]]<br />
<br />
<br />
===Resources===<br />
----<br />
* [[Woodward]]<br />
<br />
* [[Fermi]]<br />
<br />
<br />
===Programming===<br />
----<br />
<br />
* [[BASH]]<br />
<br />
* [[Python]]<br />
<br />
* [[C++]]<br />
<br />
<br />
===Links===<br />
----<br />
* [[Chemistry Journals]]<br />
<br />
* [[Computational Chemistry]]<br />
<br />
* [[Organic Chemistry News, Highlights and Blogs]]<br />
<br />
* [[Other Links]]<br />
<br />
<br />
== Getting started ==<br />
* [//www.mediawiki.org/wiki/Manual:Configuration_settings Configuration settings list]<br />
* [//www.mediawiki.org/wiki/Manual:FAQ MediaWiki FAQ]<br />
* [https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]<br />
* [//www.mediawiki.org/wiki/Localisation#Translation_resources Localise MediaWiki for your language]<br />
<br />
Consult the [//meta.wikimedia.org/wiki/Help:Contents User's Guide] for information on using the wiki software.</div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=Main_Page&diff=44Main Page2014-04-25T15:16:06Z<p>Tjmustard: </p>
<hr />
<div><br />
[[Public:Public Test Page]]<br />
<br />
===General===<br />
----<br />
* [[Group News]]<br />
<br />
* [[About PHYC]]<br />
<br />
* [[General Research in the PHYC Group]]<br />
<br />
* [[Collaborators]]<br />
<br />
* [http://phyc.chem.oregonstate.edu/publications Publications]<br />
<br />
<br />
===Software Related===<br />
----<br />
* [[Apple Related]]<br />
<br />
* [[Linux Related]]<br />
<br />
* [[Text Editors]]<br />
<br />
* [[Computational Software Related]]<br />
<br />
* [[Computational Software Manuals]]<br />
<br />
* [[Ad Hoc Script Collection]]<br />
<br />
* [[Strange Error Messages]]<br />
<br />
<br />
===Resources===<br />
----<br />
* [[Woodward]]<br />
<br />
* [[Fermi]]<br />
<br />
<br />
===Programming===<br />
----<br />
<br />
* [[BASH]]<br />
<br />
* [[Python]]<br />
<br />
* [[C++]]<br />
<br />
<br />
===Links===<br />
----<br />
* [[Chemistry Journals]]<br />
<br />
* [[Computational Chemistry]]<br />
<br />
* [[Organic Chemistry News, Highlights and Blogs]]<br />
<br />
* [[Other Links]]<br />
<br />
<br />
== Getting started ==<br />
* [//www.mediawiki.org/wiki/Manual:Configuration_settings Configuration settings list]<br />
* [//www.mediawiki.org/wiki/Manual:FAQ MediaWiki FAQ]<br />
* [https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]<br />
* [//www.mediawiki.org/wiki/Localisation#Translation_resources Localise MediaWiki for your language]<br />
<br />
Consult the [//meta.wikimedia.org/wiki/Help:Contents User's Guide] for information on using the wiki software.</div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=Main_Page&diff=39Main Page2014-04-25T15:14:48Z<p>Tjmustard: </p>
<hr />
<div><br />
[[Private:Public Test Page]]<br />
<br />
===General===<br />
----<br />
* [[Group News]]<br />
<br />
* [[About PHYC]]<br />
<br />
* [[General Research in the PHYC Group]]<br />
<br />
* [[Collaborators]]<br />
<br />
* [http://phyc.chem.oregonstate.edu/publications Publications]<br />
<br />
<br />
===Software Related===<br />
----<br />
* [[Apple Related]]<br />
<br />
* [[Linux Related]]<br />
<br />
* [[Text Editors]]<br />
<br />
* [[Computational Software Related]]<br />
<br />
* [[Computational Software Manuals]]<br />
<br />
* [[Ad Hoc Script Collection]]<br />
<br />
* [[Strange Error Messages]]<br />
<br />
<br />
===Resources===<br />
----<br />
* [[Woodward]]<br />
<br />
* [[Fermi]]<br />
<br />
<br />
===Programming===<br />
----<br />
<br />
* [[BASH]]<br />
<br />
* [[Python]]<br />
<br />
* [[C++]]<br />
<br />
<br />
===Links===<br />
----<br />
* [[Chemistry Journals]]<br />
<br />
* [[Computational Chemistry]]<br />
<br />
* [[Organic Chemistry News, Highlights and Blogs]]<br />
<br />
* [[Other Links]]<br />
<br />
<br />
== Getting started ==<br />
* [//www.mediawiki.org/wiki/Manual:Configuration_settings Configuration settings list]<br />
* [//www.mediawiki.org/wiki/Manual:FAQ MediaWiki FAQ]<br />
* [https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]<br />
* [//www.mediawiki.org/wiki/Localisation#Translation_resources Localise MediaWiki for your language]<br />
<br />
Consult the [//meta.wikimedia.org/wiki/Help:Contents User's Guide] for information on using the wiki software.</div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=Main_Page&diff=38Main Page2014-04-25T15:13:51Z<p>Tjmustard: </p>
<hr />
<div><br />
[[Public:Public Test Page]]<br />
<br />
===General===<br />
----<br />
* [[Group News]]<br />
<br />
* [[About PHYC]]<br />
<br />
* [[General Research in the PHYC Group]]<br />
<br />
* [[Collaborators]]<br />
<br />
* [http://phyc.chem.oregonstate.edu/publications Publications]<br />
<br />
<br />
===Software Related===<br />
----<br />
* [[Apple Related]]<br />
<br />
* [[Linux Related]]<br />
<br />
* [[Text Editors]]<br />
<br />
* [[Computational Software Related]]<br />
<br />
* [[Computational Software Manuals]]<br />
<br />
* [[Ad Hoc Script Collection]]<br />
<br />
* [[Strange Error Messages]]<br />
<br />
<br />
===Resources===<br />
----<br />
* [[Woodward]]<br />
<br />
* [[Fermi]]<br />
<br />
<br />
===Programming===<br />
----<br />
<br />
* [[BASH]]<br />
<br />
* [[Python]]<br />
<br />
* [[C++]]<br />
<br />
<br />
===Links===<br />
----<br />
* [[Chemistry Journals]]<br />
<br />
* [[Computational Chemistry]]<br />
<br />
* [[Organic Chemistry News, Highlights and Blogs]]<br />
<br />
* [[Other Links]]<br />
<br />
<br />
== Getting started ==<br />
* [//www.mediawiki.org/wiki/Manual:Configuration_settings Configuration settings list]<br />
* [//www.mediawiki.org/wiki/Manual:FAQ MediaWiki FAQ]<br />
* [https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]<br />
* [//www.mediawiki.org/wiki/Localisation#Translation_resources Localise MediaWiki for your language]<br />
<br />
Consult the [//meta.wikimedia.org/wiki/Help:Contents User's Guide] for information on using the wiki software.</div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=User:Public_Test_Page&diff=36User:Public Test Page2014-04-25T15:13:15Z<p>Tjmustard: Created page with "test page"</p>
<hr />
<div>test page</div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=Main_Page&diff=33Main Page2014-04-25T15:12:54Z<p>Tjmustard: </p>
<hr />
<div><br />
[[User:Public Test Page]]<br />
<br />
===General===<br />
----<br />
* [[Group News]]<br />
<br />
* [[About PHYC]]<br />
<br />
* [[General Research in the PHYC Group]]<br />
<br />
* [[Collaborators]]<br />
<br />
* [http://phyc.chem.oregonstate.edu/publications Publications]<br />
<br />
<br />
===Software Related===<br />
----<br />
* [[Apple Related]]<br />
<br />
* [[Linux Related]]<br />
<br />
* [[Text Editors]]<br />
<br />
* [[Computational Software Related]]<br />
<br />
* [[Computational Software Manuals]]<br />
<br />
* [[Ad Hoc Script Collection]]<br />
<br />
* [[Strange Error Messages]]<br />
<br />
<br />
===Resources===<br />
----<br />
* [[Woodward]]<br />
<br />
* [[Fermi]]<br />
<br />
<br />
===Programming===<br />
----<br />
<br />
* [[BASH]]<br />
<br />
* [[Python]]<br />
<br />
* [[C++]]<br />
<br />
<br />
===Links===<br />
----<br />
* [[Chemistry Journals]]<br />
<br />
* [[Computational Chemistry]]<br />
<br />
* [[Organic Chemistry News, Highlights and Blogs]]<br />
<br />
* [[Other Links]]<br />
<br />
<br />
== Getting started ==<br />
* [//www.mediawiki.org/wiki/Manual:Configuration_settings Configuration settings list]<br />
* [//www.mediawiki.org/wiki/Manual:FAQ MediaWiki FAQ]<br />
* [https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]<br />
* [//www.mediawiki.org/wiki/Localisation#Translation_resources Localise MediaWiki for your language]<br />
<br />
Consult the [//meta.wikimedia.org/wiki/Help:Contents User's Guide] for information on using the wiki software.</div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=Main_Page&diff=30Main Page2014-04-25T15:11:44Z<p>Tjmustard: </p>
<hr />
<div><br />
[[Help:Public Test Page]]<br />
<br />
===General===<br />
----<br />
* [[Group News]]<br />
<br />
* [[About PHYC]]<br />
<br />
* [[General Research in the PHYC Group]]<br />
<br />
* [[Collaborators]]<br />
<br />
* [http://phyc.chem.oregonstate.edu/publications Publications]<br />
<br />
<br />
===Software Related===<br />
----<br />
* [[Apple Related]]<br />
<br />
* [[Linux Related]]<br />
<br />
* [[Text Editors]]<br />
<br />
* [[Computational Software Related]]<br />
<br />
* [[Computational Software Manuals]]<br />
<br />
* [[Ad Hoc Script Collection]]<br />
<br />
* [[Strange Error Messages]]<br />
<br />
<br />
===Resources===<br />
----<br />
* [[Woodward]]<br />
<br />
* [[Fermi]]<br />
<br />
<br />
===Programming===<br />
----<br />
<br />
* [[BASH]]<br />
<br />
* [[Python]]<br />
<br />
* [[C++]]<br />
<br />
<br />
===Links===<br />
----<br />
* [[Chemistry Journals]]<br />
<br />
* [[Computational Chemistry]]<br />
<br />
* [[Organic Chemistry News, Highlights and Blogs]]<br />
<br />
* [[Other Links]]<br />
<br />
<br />
== Getting started ==<br />
* [//www.mediawiki.org/wiki/Manual:Configuration_settings Configuration settings list]<br />
* [//www.mediawiki.org/wiki/Manual:FAQ MediaWiki FAQ]<br />
* [https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]<br />
* [//www.mediawiki.org/wiki/Localisation#Translation_resources Localise MediaWiki for your language]<br />
<br />
Consult the [//meta.wikimedia.org/wiki/Help:Contents User's Guide] for information on using the wiki software.</div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=Public:Public_Test_Page&diff=28Public:Public Test Page2014-04-25T00:11:47Z<p>Tjmustard: Created page with "Hey this is a public test page."</p>
<hr />
<div>Hey this is a public test page.</div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=Main_Page&diff=27Main Page2014-04-25T00:11:27Z<p>Tjmustard: </p>
<hr />
<div><br />
[[Public:Public Test Page]]<br />
<br />
===General===<br />
----<br />
* [[Group News]]<br />
<br />
* [[About PHYC]]<br />
<br />
* [[General Research in the PHYC Group]]<br />
<br />
* [[Collaborators]]<br />
<br />
* [http://phyc.chem.oregonstate.edu/publications Publications]<br />
<br />
<br />
===Software Related===<br />
----<br />
* [[Apple Related]]<br />
<br />
* [[Linux Related]]<br />
<br />
* [[Text Editors]]<br />
<br />
* [[Computational Software Related]]<br />
<br />
* [[Computational Software Manuals]]<br />
<br />
* [[Ad Hoc Script Collection]]<br />
<br />
* [[Strange Error Messages]]<br />
<br />
<br />
===Resources===<br />
----<br />
* [[Woodward]]<br />
<br />
* [[Fermi]]<br />
<br />
<br />
===Programming===<br />
----<br />
<br />
* [[BASH]]<br />
<br />
* [[Python]]<br />
<br />
* [[C++]]<br />
<br />
<br />
===Links===<br />
----<br />
* [[Chemistry Journals]]<br />
<br />
* [[Computational Chemistry]]<br />
<br />
* [[Organic Chemistry News, Highlights and Blogs]]<br />
<br />
* [[Other Links]]<br />
<br />
<br />
== Getting started ==<br />
* [//www.mediawiki.org/wiki/Manual:Configuration_settings Configuration settings list]<br />
* [//www.mediawiki.org/wiki/Manual:FAQ MediaWiki FAQ]<br />
* [https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]<br />
* [//www.mediawiki.org/wiki/Localisation#Translation_resources Localise MediaWiki for your language]<br />
<br />
Consult the [//meta.wikimedia.org/wiki/Help:Contents User's Guide] for information on using the wiki software.</div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=Category:Public&diff=24Category:Public2014-04-24T22:55:43Z<p>Tjmustard: Created page with "These pages are available for reading by the public."</p>
<hr />
<div>These pages are available for reading by the public.</div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=About_PHYC&diff=23About PHYC2014-04-24T22:55:00Z<p>Tjmustard: </p>
<hr />
<div>;Paul Ha-Yeon Cheong<br />
<br />
----<br />
<br />
===Contact Information===<br />
<br />
----<br />
<br />
====Mailing Address====<br />
:Department of Chemistry<br />
:Oregon State University<br />
:153 Gilbert Hall<br />
:Room 303<br />
:Corvallis, OR 97331<br />
<br />
----<br />
<br />
====Telephone====<br />
:541-737-6760<br />
;e-Mail<br />
:paulhcheong(at)gmail.com<br />
<br />
----<br />
<br />
===Education===<br />
:2007 - 2009 Postdoctoral Associate, University of California, Los Angeles: Principal Investigator: K. N. Houk<br />
:2002 - Nov. 2007 Ph. D. in Organic Chemistry, University of California, Los Angeles: Thesis advisor: K. N. Houk<br />
:1997 - 2001 AB, Bowdoin College, Brunswick, ME: Independent Research Advisor: Faraj Hasanayn<br />
<br />
----<br />
<br />
===Experience===<br />
:2009 Assistant Professor: Oregon State University<br />
:2007 - 2009 Postdoctoral Associate: University of California, Los Angeles<br />
:2002 - 2007 Research Assistant: University of California, Los Angeles<br />
:2003 - 2006 Graduate Teaching Assistant Consultant: University of California, Los Angeles<br />
:2002 - 2005 Graduate Teaching Assistant: University of California, Los Angeles<br />
:2001 - 2002 Assistant Academic Curricula Developer: Bowdoin College<br />
:1998 - 2001 Undergraduate Teaching Assistant: Bowdoin College<br />
<br />
----<br />
<br />
===Awards & Fellowships===<br />
:2009 Vicki and Patrick F. Stone Scholar<br />
:2009 MBI Amgen Postdoctoral Award<br />
:2007 Thomas L. and Ruth F. Jacobs Award<br />
:2006 John Stauffer Fellowship<br />
:2006 - 2007 UCLA Graduate Division Dissertation Year Fellowship<br />
:2002 - 2007 UCLA Graduate Fellowship<br />
:2001 Hypercube scholar award (Hyperchem 6.0)<br />
<br />
----<br />
<br />
===Conference Oral Presentations===<br />
:Aug., 2008 Computational Investigations of Ni and Rh Catalyzed CC Bond-Formation, Houk, K. N.; Cheong, P. H.-Y.; Liu, P.; McCarren, P. 236th ACS National Meeting, Philadelphia, Pennsylvania <br />
:Sept., 2006 The mechanism and the origins of stereoselectivity in the Rh(I)-Josiphos-catalyzed asymmetric hydrogenation of unprotected enamines: A computational study, Cheong, P. H.-Y.; Zhao, Y.-L.; Houk, K. N.; Rosner, T. 232nd ACS National Meeting, San Francisco, California <br />
:Sept., 2006 Mechanism of the Au(I)-catalyzed enyne cycloisomerization reaction, Cheong, P. H.-Y.; Houk, K. N.; Toste, F. D. 232nd ACS National Meeting, San Francisco, California<br />
:Aug., 2005 Rational design of organocatalysts using quantum mechanical calculations: Towards new catalytic proline derivatives for the diastereoselective intermolecular aldol and Mannich reactions, Cheong, P. H.-Y.; Houk, K. N.; Zhang, H.; Thayumanavan, F.; Tanaka, F; Barbas, C. F., III, 230th ACS National Meeting. San Diego, California<br />
:Conference Poster Presentations<br />
:Aug., 2008 Synthetic Scope and Mechanistic Origin of a New Series of Exo-Selective Intermolecular Diels-Alder Reactions, Lam, C.; Cheong, P. H.-Y.; Blasco Mata, J. M.; Stanway, S. J.; Gouverneur, V.; Houk, K. N. Tetrahedron Symposium, Berkeley, California<br />
:Jun., 2008 Quantum Mechanical Investigations of Mechanisms and Selectivities of Organometallic Reactions, Cheong, P. H.-Y.; Legault, C. Y.; Liu, P.; Iafe, R.; Cheong, M.; McCarren, P.; Houk, K. N. Houk65 Symposium - Organo, Bio, Nano, University of California, Los Angeles, California <br />
:Jun., 2007 Theory and Modeling of Stereoselective Organic Reactions, Cheong, P. H.-Y.; Legault, C. Y.; Lin, L.; Luft, J. A. R.; Um, J. M.; Houk, K. N. 232nd UCLA Graduate Symposium<br />
<br />
----<br />
<br />
===Lectures===<br />
:Jun., 2008 The Origins of Catalytic Efficiencies of Various Monomeric Rh(I)-Catalyzed (5+2) Cycloaddition Reaction, Houk 65 Symposium, University of California Los Angeles <br />
:Mar., 2008 Computational Investigation of the Mechanism and Selectivities of Planar Chiral Bronsted Acid Catalysis, Gregory C. Fu group, Massachusetts Institute of Technology <br />
:Feb., 2008 Mechanisms and Selectivities of the Jamison Nickel Chemistry, Tim Jamison group, Massachusetts Institute of Technology <br />
:Jan., 2008 Computational Investigations of Synthetic Organic Reactions, Stephen L. Buchwald group, Massachusetts Institute of Technology <br />
:Mar., 2007 Rh(I)-catalyzed (5+2) Cycloaddition Reactions: A Computational Study into the Mechanism, Substrate Selectivities, Regioselectivity, and Catalyst Efficacy, Paul A. Wender group, Stanford University<br />
:Aug., 2006 Au(I)-catalysis and the enyne cycloisomerization reaction, F. Dean Toste group, University of California, Berkeley<br />
:Jan., 2006 Computational design of organocatalysts for the asymmetric mannich reactions: origins of diastereoselectivity and design principles for new diastereoselective reactions, Cheong, P. H.-Y.; Houk, K. N.; Barbas, C. F., III. 40th ACS Western Regional Meeting, Anaheim, California (oral)<br />
:Dec., 2005 Mechanisms and origins of stereoselectivity of organocatalysts, Donna Blackmond group, Imperial College, London, UK<br />
<br />
[[Category:Public]]</div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=Public:Collaborators&diff=21Public:Collaborators2014-04-24T22:49:18Z<p>Tjmustard: Created page with "==Paul A. Wender== File:WenderPA.jpeg :Stanford University :Lorry Lokey Building :337 Campus Drive, Mail Code #5080 :Stanford, CA 94305-5080 ==F. Dean Toste== File:..."</p>
<hr />
<div>==Paul A. Wender==<br />
[[File:WenderPA.jpeg]]<br />
:Stanford University <br />
:Lorry Lokey Building <br />
:337 Campus Drive, Mail Code #5080 <br />
:Stanford, CA 94305-5080<br />
<br />
<br />
==F. Dean Toste==<br />
[[File:TosteFD.jpeg]]<br />
:University of California, Berkeley<br />
:Dept. of Chemistry, MC 1460<br />
:Berkeley, CA 94720-1460<br />
<br />
<br />
==Gregory C. Fu==<br />
[[File:FuGC.png]]<br />
:Massachusetts Institute of Technology<br />
:Department of Chemistry<br />
:77 Massachusetts Avenue, Room 18-290<br />
:Cambridge, MA 02139-4307 USA<br />
<br />
<br />
==Martin D. Burke==<br />
[[File:BurkeMD.jpeg]]<br />
:University of Illinois<br />
:Department of Chemistry<br />
:454 Roger Adams Laboratory<br />
:600 South Mathews Ave.<br />
:Urbana, IL 61801<br />
<br />
<br />
==Rich G. Carter==<br />
[[File:CarterRG.jpeg]]<br />
Gilbert Hall, Rm 301 <br />
Oregon State University <br />
Corvallis, OR 97331</div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=General_Research_in_the_PHYC_Group&diff=19General Research in the PHYC Group2014-04-24T22:48:48Z<p>Tjmustard: Created page with "==The Advance of Synthesis through the Advance of Theory== Considerable recent advances in stereoselective synthesis allow great control over the processes that effect bond-fo..."</p>
<hr />
<div>==The Advance of Synthesis through the Advance of Theory==<br />
Considerable recent advances in stereoselective synthesis allow great control over the processes that effect bond-forming and functional group transformations. These discoveries enable the efficient construction of molecules that conquer disease and influence biology. I seek to use computations to advance synthesis, by perfecting computational techniques to discover, explain, and quantify factors that control the selectivities and reactivities of complex synthetic organic reactions. The ultimate achievement of this line of research will be the routine and accurate prediction and design of selectivity and reactivity of homogeneous catalysts of all types and sizes.<br />
<br />
<br />
==Theory of Organic Catalysis - Organocatalysis to Peptides to Enzymes==<br />
Catalysis based on natural enzymes and proteins is the new frontier of green and efficient syntheses. The best of these reactions catalyzed by synthetic peptides rival the selectivities observed in enzymatic reactions. An example of this is Miller's discovery of a synthetic peptide for the selective acylation of the most hindered endo-macrocyclic hydroxyl in the natural product Erythromycin A (>10:1).<br />
<br />
[[File:General-Organic-Miller-Peptides.png]]<br />
<br />
The computational study of catalysis involving large organic systems is the subject of active pursuit by numerous groups, but none of these methods are routine, and all require substantial commitments of resources without a guarantee of success. In the past, I have been successful in understanding the selectivity of simple examples of organocatalysis, and have been at the forefront of the design of new organocatalysts. Now I seek to pursue the formidable challenge of understanding and design of more complex systems. This requires the development of techniques beyond what is available today. My research will perfect the computational tools to simulate, analyze, and predict the three dimensional structures, preorganization, selectivities, and reactivities of organic catalysts, from the small molecule catalysts to peptides, and finally to enzymes.<br />
<br />
<br />
==Theory of Transition Metal Catalysis - Rh(I)-Catalyzed C-C Bond Activation Reactions and Au(I)-Catalyzed Rearrangement Reactions==<br />
Despite the tremendous progress in the development of new reactions, ligands, and theory, we have only begun to tap the power of transition metal catalysis. For example, a number of intermolecular Rh(I)-catalyzed multicomponent cyclo-addition reactions involving vinylcyclopropane, alkynes, and CO are shown below. Those on the right occur, while those on the left have not been observed to date.<br />
<br />
[[File:General-TM-Wender-Rh.png]]<br />
<br />
The factors that determine the reactivity and selectivity of these processes are not well understood. In the past, I have been involved in close collaborations with the Wender and Toste groups in using computations to address specific aspects of Rh(I)- an Au(I)-catalysis. Now in my independent career, my research will establish general principles that will explain and predict Rh(I)- and Au(I)-catalyzed processes involving a wide variety of substrates. The goals are to develop useful qualitative and quantitative tools to predict the products of reactions involving a wide variety of substrates. In the end, my research will result in the complete understanding of Rh(I)- and Au(I)-catalysis, encompassing the reactivity trends of catalysts, preferred mechanisms, stable intermediates, driving forces, and substrate-, stereo-, regio-, and chemoselectivity.<br />
References</div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=About_PHYC&diff=16About PHYC2014-04-24T22:48:12Z<p>Tjmustard: Created page with ";Paul Ha-Yeon Cheong ---- ===Contact Information=== ---- ====Mailing Address==== :Department of Chemistry :Oregon State University :153 Gilbert Hall :Room 303 :Corvallis, ..."</p>
<hr />
<div>;Paul Ha-Yeon Cheong<br />
<br />
----<br />
<br />
===Contact Information===<br />
<br />
----<br />
<br />
====Mailing Address====<br />
:Department of Chemistry<br />
:Oregon State University<br />
:153 Gilbert Hall<br />
:Room 303<br />
:Corvallis, OR 97331<br />
<br />
----<br />
<br />
====Telephone====<br />
:541-737-6760<br />
;e-Mail<br />
:paulhcheong(at)gmail.com<br />
<br />
----<br />
<br />
===Education===<br />
:2007 - 2009 Postdoctoral Associate, University of California, Los Angeles: Principal Investigator: K. N. Houk<br />
:2002 - Nov. 2007 Ph. D. in Organic Chemistry, University of California, Los Angeles: Thesis advisor: K. N. Houk<br />
:1997 - 2001 AB, Bowdoin College, Brunswick, ME: Independent Research Advisor: Faraj Hasanayn<br />
<br />
----<br />
<br />
===Experience===<br />
:2009 Assistant Professor: Oregon State University<br />
:2007 - 2009 Postdoctoral Associate: University of California, Los Angeles<br />
:2002 - 2007 Research Assistant: University of California, Los Angeles<br />
:2003 - 2006 Graduate Teaching Assistant Consultant: University of California, Los Angeles<br />
:2002 - 2005 Graduate Teaching Assistant: University of California, Los Angeles<br />
:2001 - 2002 Assistant Academic Curricula Developer: Bowdoin College<br />
:1998 - 2001 Undergraduate Teaching Assistant: Bowdoin College<br />
<br />
----<br />
<br />
===Awards & Fellowships===<br />
:2009 Vicki and Patrick F. Stone Scholar<br />
:2009 MBI Amgen Postdoctoral Award<br />
:2007 Thomas L. and Ruth F. Jacobs Award<br />
:2006 John Stauffer Fellowship<br />
:2006 - 2007 UCLA Graduate Division Dissertation Year Fellowship<br />
:2002 - 2007 UCLA Graduate Fellowship<br />
:2001 Hypercube scholar award (Hyperchem 6.0)<br />
<br />
----<br />
<br />
===Conference Oral Presentations===<br />
:Aug., 2008 Computational Investigations of Ni and Rh Catalyzed CC Bond-Formation, Houk, K. N.; Cheong, P. H.-Y.; Liu, P.; McCarren, P. 236th ACS National Meeting, Philadelphia, Pennsylvania <br />
:Sept., 2006 The mechanism and the origins of stereoselectivity in the Rh(I)-Josiphos-catalyzed asymmetric hydrogenation of unprotected enamines: A computational study, Cheong, P. H.-Y.; Zhao, Y.-L.; Houk, K. N.; Rosner, T. 232nd ACS National Meeting, San Francisco, California <br />
:Sept., 2006 Mechanism of the Au(I)-catalyzed enyne cycloisomerization reaction, Cheong, P. H.-Y.; Houk, K. N.; Toste, F. D. 232nd ACS National Meeting, San Francisco, California<br />
:Aug., 2005 Rational design of organocatalysts using quantum mechanical calculations: Towards new catalytic proline derivatives for the diastereoselective intermolecular aldol and Mannich reactions, Cheong, P. H.-Y.; Houk, K. N.; Zhang, H.; Thayumanavan, F.; Tanaka, F; Barbas, C. F., III, 230th ACS National Meeting. San Diego, California<br />
:Conference Poster Presentations<br />
:Aug., 2008 Synthetic Scope and Mechanistic Origin of a New Series of Exo-Selective Intermolecular Diels-Alder Reactions, Lam, C.; Cheong, P. H.-Y.; Blasco Mata, J. M.; Stanway, S. J.; Gouverneur, V.; Houk, K. N. Tetrahedron Symposium, Berkeley, California<br />
:Jun., 2008 Quantum Mechanical Investigations of Mechanisms and Selectivities of Organometallic Reactions, Cheong, P. H.-Y.; Legault, C. Y.; Liu, P.; Iafe, R.; Cheong, M.; McCarren, P.; Houk, K. N. Houk65 Symposium - Organo, Bio, Nano, University of California, Los Angeles, California <br />
:Jun., 2007 Theory and Modeling of Stereoselective Organic Reactions, Cheong, P. H.-Y.; Legault, C. Y.; Lin, L.; Luft, J. A. R.; Um, J. M.; Houk, K. N. 232nd UCLA Graduate Symposium<br />
<br />
----<br />
<br />
===Lectures===<br />
:Jun., 2008 The Origins of Catalytic Efficiencies of Various Monomeric Rh(I)-Catalyzed (5+2) Cycloaddition Reaction, Houk 65 Symposium, University of California Los Angeles <br />
:Mar., 2008 Computational Investigation of the Mechanism and Selectivities of Planar Chiral Bronsted Acid Catalysis, Gregory C. Fu group, Massachusetts Institute of Technology <br />
:Feb., 2008 Mechanisms and Selectivities of the Jamison Nickel Chemistry, Tim Jamison group, Massachusetts Institute of Technology <br />
:Jan., 2008 Computational Investigations of Synthetic Organic Reactions, Stephen L. Buchwald group, Massachusetts Institute of Technology <br />
:Mar., 2007 Rh(I)-catalyzed (5+2) Cycloaddition Reactions: A Computational Study into the Mechanism, Substrate Selectivities, Regioselectivity, and Catalyst Efficacy, Paul A. Wender group, Stanford University<br />
:Aug., 2006 Au(I)-catalysis and the enyne cycloisomerization reaction, F. Dean Toste group, University of California, Berkeley<br />
:Jan., 2006 Computational design of organocatalysts for the asymmetric mannich reactions: origins of diastereoselectivity and design principles for new diastereoselective reactions, Cheong, P. H.-Y.; Houk, K. N.; Barbas, C. F., III. 40th ACS Western Regional Meeting, Anaheim, California (oral)<br />
:Dec., 2005 Mechanisms and origins of stereoselectivity of organocatalysts, Donna Blackmond group, Imperial College, London, UK</div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=Public:Group_News&diff=13Public:Group News2014-04-24T22:47:35Z<p>Tjmustard: Created page with "==2011.08.15 - Cluster== The test GPU node is tested with QM program! Whopping performance!!! ==2011.06.15 - Cluster== The test GPU node is constructed and tested with GROMAC..."</p>
<hr />
<div>==2011.08.15 - Cluster==<br />
The test GPU node is tested with QM program! Whopping performance!!!<br />
<br />
==2011.06.15 - Cluster==<br />
The test GPU node is constructed and tested with GROMACS.<br />
<br />
==2011.01.05 - Cluster==<br />
The second generation expansion of the Woodward cluster just added, tripling our core count!<br />
<br />
<br />
==2010.11.08 - Arrival==<br />
Postdoc I-Ya Chang arrived from Taiwan!<br />
<br />
<br />
==2010.11.04 - Software==<br />
Q-Chem 3.2 license extended to 2011.<br />
<br />
<br />
==2010.09.12 - Software==<br />
OSU TRF funding for Gaussian09 and GaussView5 approved!<br />
OSU TRF Funding for 3 more years of ChemDrawUltra approved!<br />
<br />
<br />
==2010.07.23 - Cluster==<br />
The Borg cluster goes up, thanks to TJ!<br />
<br />
<br />
==2010.07.05 - Group member(s)==<br />
TJ Mustard and George Burgess have joined the lab as graduate students!<br />
<br />
<br />
==2010.05.15 - Software==<br />
PHYC, Chemistry and Pharmacy agrees on a deal to pay for first year license of ChemDrawUltra for all of OSU!<br />
<br />
<br />
==2010.02.05 - Group member(s)==<br />
Nilobon Pattawong and Matthew Pierce has joined the lab as graduate student!<br />
<br />
<br />
==2009.10.08 - Group member(s)==<br />
Subham Mahaptra has joined the lab as joint graduate student with Professor Rich Carter!<br />
<br />
<br />
==2009 09 27 - Software==<br />
Openeye, VCONF, and Babel installed and configured on Woodward!<br />
<br />
<br />
==2009 09 25 - Queue==<br />
Parallel queues (SMP, MPI) implemented on Woodward!<br />
<br />
<br />
==2009 09 24 - Software==<br />
Gaussian, Q-Chem, NWChem, NAMD, and GROMACS installed and configured on Woodward!<br />
<br />
<br />
==2009 09 22 - Cluster==<br />
Cluster status now available online!<br />
<br />
<br />
==2009 09 21 - Cluster==<br />
The Woodward cluster has arrived! Many thanks to friends from Silicon Mechanics (Art Mann and Scott Humphreys).<br />
<br />
<br />
==2009 08 15 - Coworker==<br />
Dr. I-Ya Chang has decided to join the lab as postdoc!<br />
<br />
<br />
==2009 05 13 - Awards==<br />
PHYC wins the Boyer-AMGEN postdoctoral award!</div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=Main_Page&diff=10Main Page2014-04-24T17:47:52Z<p>Tjmustard: </p>
<hr />
<div><br />
===General===<br />
----<br />
* [[Group News]]<br />
<br />
* [[About PHYC]]<br />
<br />
* [[General Research in the PHYC Group]]<br />
<br />
* [[Collaborators]]<br />
<br />
* [http://phyc.chem.oregonstate.edu/publications Publications]<br />
<br />
<br />
===Software Related===<br />
----<br />
* [[Apple Related]]<br />
<br />
* [[Linux Related]]<br />
<br />
* [[Text Editors]]<br />
<br />
* [[Computational Software Related]]<br />
<br />
* [[Computational Software Manuals]]<br />
<br />
* [[Ad Hoc Script Collection]]<br />
<br />
* [[Strange Error Messages]]<br />
<br />
<br />
===Resources===<br />
----<br />
* [[Woodward]]<br />
<br />
* [[Fermi]]<br />
<br />
<br />
===Programming===<br />
----<br />
<br />
* [[BASH]]<br />
<br />
* [[Python]]<br />
<br />
* [[C++]]<br />
<br />
<br />
===Links===<br />
----<br />
* [[Chemistry Journals]]<br />
<br />
* [[Computational Chemistry]]<br />
<br />
* [[Organic Chemistry News, Highlights and Blogs]]<br />
<br />
* [[Other Links]]<br />
<br />
<br />
== Getting started ==<br />
* [//www.mediawiki.org/wiki/Manual:Configuration_settings Configuration settings list]<br />
* [//www.mediawiki.org/wiki/Manual:FAQ MediaWiki FAQ]<br />
* [https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]<br />
* [//www.mediawiki.org/wiki/Localisation#Translation_resources Localise MediaWiki for your language]<br />
<br />
Consult the [//meta.wikimedia.org/wiki/Help:Contents User's Guide] for information on using the wiki software.</div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=Main_Page&diff=8Main Page2014-04-24T17:44:40Z<p>Tjmustard: </p>
<hr />
<div><br />
===General===<br />
----<br />
* [[Group News]]<br />
<br />
* [[About PHYC]]<br />
<br />
* [[General Research in the PHYC Group]]<br />
<br />
* [[Collaborators]]<br />
<br />
* [http://phyc.chem.oregonstate.edu/publications Publications]<br />
<br />
<br />
===Links===<br />
----<br />
* [[Chemistry Journals]]<br />
<br />
* [[Computational Chemistry]]<br />
<br />
* [[Organic Chemistry News, Highlights and Blogs]]<br />
<br />
* [[Other Links]]<br />
<br />
<br />
== Getting started ==<br />
* [//www.mediawiki.org/wiki/Manual:Configuration_settings Configuration settings list]<br />
* [//www.mediawiki.org/wiki/Manual:FAQ MediaWiki FAQ]<br />
* [https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]<br />
* [//www.mediawiki.org/wiki/Localisation#Translation_resources Localise MediaWiki for your language]<br />
<br />
Consult the [//meta.wikimedia.org/wiki/Help:Contents User's Guide] for information on using the wiki software.</div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=Main_Page&diff=5Main Page2014-04-24T17:44:07Z<p>Tjmustard: </p>
<hr />
<div><br />
===General===<br />
----<br />
* [[Group News]]<br />
<br />
* [[About PHYC]]<br />
<br />
* [[General Research in the PHYC Group]]<br />
<br />
* [[Collaborators]]<br />
<br />
* [http://phyc.chem.oregonstate.edu/publications Publications]<br />
<br />
<br />
== Getting started ==<br />
* [//www.mediawiki.org/wiki/Manual:Configuration_settings Configuration settings list]<br />
* [//www.mediawiki.org/wiki/Manual:FAQ MediaWiki FAQ]<br />
* [https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]<br />
* [//www.mediawiki.org/wiki/Localisation#Translation_resources Localise MediaWiki for your language]<br />
<br />
Consult the [//meta.wikimedia.org/wiki/Help:Contents User's Guide] for information on using the wiki software.</div>Tjmustardhttps://phyc-wiki.chem.oregonstate.edu/index.php?title=Main_Page&diff=3Main Page2014-04-24T17:42:49Z<p>Tjmustard: </p>
<hr />
<div><br />
===General===<br />
----<br />
* [[Group News]]<br />
<br />
* [[About PHYC]]<br />
<br />
* [[General Research in the PHYC Group]]<br />
<br />
* [[Collaborators]]<br />
<br />
<br />
<br />
<br />
== Getting started ==<br />
* [//www.mediawiki.org/wiki/Manual:Configuration_settings Configuration settings list]<br />
* [//www.mediawiki.org/wiki/Manual:FAQ MediaWiki FAQ]<br />
* [https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce MediaWiki release mailing list]<br />
* [//www.mediawiki.org/wiki/Localisation#Translation_resources Localise MediaWiki for your language]<br />
<br />
Consult the [//meta.wikimedia.org/wiki/Help:Contents User's Guide] for information on using the wiki software.</div>Tjmustard