Bash/Korn shell script edited on Windows throws error '...^M: not found'

After snooping around various forums and some Stack-overflow post I found the issue.

Here is an explanation to better understand and 'see' the root cause of the errors.

First off if you are writing code on Windows, better arm yourself with Notepad++. It's basically the Swiss Army knife of text-editors in my opinion.

Now to have a look at the EOL (end-of-line) characters and other control symbols do the following:

1.Open the file in Notepad++.

Select View > Show Symbol > Show All Characters from the Menu bar

You should now see the symbols as follows: Screenshot of Notepad++:Editing a UNIX script on Windows

Aha! Windows/MS-DOS uses CR+LF to indicate end-of-lines. Now UNIX uses LF character to indicate line termination (EOL character).

2.1.Let's convert the Windows EOL into UNIX EOLs:

Select EDIT > EOL Conversion > UNIX Format

You should see something like this:

Screenshot of Notepad++: EOL Conversion to UNIX Format This explains why we saw the '\r' character getting appended at the end of the line. This is because UNIX recognized the '\n' or LF (linefeed) as the line termination/EOL character but ignore the '\r' or ^M (carriage return) character.

We can also test for the EOL issue by

bash-3.00$ head myScript.sh | cat -vet | head -1
#usr/bin/bash^M$
bash-3.00$ #We see that ^M, that is \r is found at the end of each line. 

2.2.If you would like convert the file from Windows to UNIX EOL format on UNIX then there are two ways of fixing this:

$ dos2unix myScript.sh

or

Use the solution provided by @Chris Down as below:

$ sed -i 's/\r$//' myScript.sh

References:

  1. For more information on line termination and what-is-the-difference-between-r-and-n refer these links.

Your script contains CRLF line endings, whereas Unix uses LF line endings. The following will remove them, if you have GNU sed:

sed -i 's/\r$//' cxStopAllServicesOnSERVER.sh

If you don't have GNU sed, write to a temporary file, and then move it over the top of the old file.

As an aside, if you invoke a script using sh, you will override the shebang. That's probably not what you want.