The following software list is idiosyncratic. I have tried to make it generally useful for economists. I favor cross-platform solutions, since I view the current near monopoly of the end-user operating system as a momentary historical aberration. Suggested changes and additions are welcome. A resource complementary to this page is RFE's Software page.
First things first, and having a decent text editor is probably first. All other things equal, multi-platform solutions are always preferable. Nowadays having an editor that nicely handles utf-8 is pretty important. (See Unicode hints.) I suggest Vim. It is highly configurable, available on essentially every platform (even WinCE), and quite wonderfully designed. On top of all this, it is charityware: you pay nothing for this excellent software, but users are encouraged to make a donation for needy children in Uganda.
See Vim user hints.
Other multi-platform solutions:
There are many alternatives.
A newer and interesting possibility is Geany. (License: GPL)
If you are looking for small, fast, and free,
start with nano.
For big, powerful, and free you can try emacs.
(Windows users may wish to consider Goulet's modified emacs for Windows.)
Many users will find the somewhat less powerful but much smaller mg provides sufficient emacs style functionality.
(There are Windows ports of emacs and of mg.
There is a mailing list,
which is archived.)
Some prefer the closely related XEmacs.
JED is reputed to be fast and powerful,
and it has a particularly powerful macro language.
The Hessling Editor (THE) gets raves and uses REXX as its scripting language.
This makes it very powerful, and it has some unusual and excellent features
(see, e.g., the 'all' command, which Vim approximates with 'folddoopen').
SciTE is a multi-platform source-code editor with some interesting and powerful features:
it can be scripted with the Lua programming language,
and it is based on Scintilla.
Komodo Edit is a promising open-source editor,
the same one used in ActiveState's commercial Komodo IDE.
Finally I have to mention the unusual Lapis editor,
which allows simultaneous selection of discontinuous segments of text.
Aside: for the curious or those who need to fit a modal editor on a floppy, you can get the traditional vi editor, which has been free and open source since 2002.
Very specialized: the Java based Record Editor may be just what you need if you are working with fixed-field-length data files.
Generally any good text editor with syntax highlighting will be fine for HTML editing, but Nvu is of additional interest: is is based on the Mozilla Composer code base, so it offers WYSIWYG editing of HTML that for moderately sophisticated use rivals DreamWeaver and FrontPage. (License: MPL/LGPL/GPL tri-license.)
Mac users can try SubEthaEdit.
Before listing some monospaced fonts, I must note the wonderful STIX font project. These are "a comprehensive set of fonts that serve the scientific and engineering community". and are available under a royalty free (and fairly liberal) license. (TeX users should check these out!) After a long wait, the fonts were released in May 2010.
Once you have chosen your editor, you may want to find yourself a decent monospaced font, especially if you anticipate doing much programming. More extensive discussions are offered by Keith Devens and Kuro5hin; my brief observations follow. Most systems include some version of CourierNew, which is adequate, or LucidaConsole, which is pretty good. (Unfortunately, neither adequately distinguishes 0 from O, and many monospace fonts share this failing.) A newer and popular option is MicroSoft Consolas, which is a TrueTypeClearType font. My favorite is the TrueType font Andale Mono, a TrueType font that I find exceptionally readable even at small font sizes. Courier Dot 15 CPI is a very promising free and open source effort. Mac users may wish to investigate Courier Web. There is a public domain, monospace, Unicode (!) font, which will hopefully be superceded by the recently quiescent FreeFont fonts (find the FreeFont fonts here). Some people like Anonymous or Courier 15 CPI. There is also a more narrowly focused but very useful APL font (SImPL.TTF). The shareware Everson Mono Unicode has a good reputation for its Unicode support, but I find it difficult to read at small font sizes. Those needing a small font-size might consider the ProFont bitmap font, which looks great at 9pt. (Available for Windows and Mac.) I have heard good things about Bitstream's Vera Fonts, from which the DejaVu fonts are derivative. (The DejaVu fonts are available as a Latin-Cyrillic-Greek subset.) Linux users can consider the Terminus Font, which I have heard good things about. Finally, should you get ambitious enough to design your own, consider using DoubleType, and let me know about your efforts.
Good commercial fonts: Pragmata, Consolas
Gentium is a high-quality FOSS unicode font set.
The Arev fonts are useful for presentations containing math.
The most natural approach to spell checking is modular, but many editors nevertheless include their own spell checker. If yours does not, there are many free options. Perhaps the most obvious cross-platform option is Aspell. (If you will use the Windows release, see Aspell hints.) Aspell derives from the more famous ispell. (There seem to be separate implementations of ispell for Unix and OS/2 and ispell for Win95/NT. You can also try jspell in a DOS environment.) If you need a spell checker for general Windows applications, try All-Purpose Spell Checker or Spell Checker for Edit Boxes. (They are free.)
Vim 7+ includes a spell checker. You can also integrate Vim with aspell, which is my preference.
These days, your favorite dictionaries and thesauri are probably available free online. My favorite is The American Heritage® Dictionary of the English Language. Unfortunately the online interface is rather clunky. The DICT Development Group offers a free online dictionary that is very fast. Wiktionary shows great promise and is pretty fast. In addition, you can submit a query for "yourword" directly as http://www.dict.org/bin/Dict?Form=Dict1&Query=yourword&Strategy=*&Database=*. Windows users can download for free the Freelang translation dictionaries.
Aiksaurus is a powerful, free, cross-platform thesaurus. Windows users can download WordWeb for free.
The only stream editor I have experience with is sed, which is very fast, powerful, and cross platform. (License: GPL) For an introductory tutorial, try SED: A Non-interactive Text Editor. If you decide to use sed a lot, you may wish to try sedsed, and Python-based sed debugger.
A good cross platform solution is Open Office, which includes the oomath formula editor. Open Office is free and open source software.
Another cross platform solution is AbiWord, which brilliantly uses MathML as its internal representation of mathematics. AbiMath can import MathML equations. AbiWord also support itex for equation input, which is quite wonderful.
For Windows users, the most common approach is Microsoft Word with embedded Equation Editor equations. This is a pretty clumsy environment if your writing includes much mathematics, but it is widely used. Slightly better might be to use Aurora, which allows you to embed typeset equations into a Word document. (Shareware.) The scientific word processor EXP has a WYSIWYG interface and supports LaTeX file conversion. Equation Magic Lite is a free OLE-based equation editor for Win 95/98 and WinNT/4.
Some working environments allow you to see your mathematics in a form closely related to how it will be printed, while reserving polished document formatting to a separate "typesetting" process. Anyone who has printed a web page is familiar with the difference between the screen display and the typeset printed version (or "print preview") of the document: just imagine directly editing such a screen display before typesetting your document. These are sometimes called WYSIWYM (what you see is what you mean) environments.
The most popular WYSIWYM environments are interfaces to an underlying LaTeX document.
In such an environment,
you will see for example the glyph β instead of the LaTeX code \beta.
The only cross-platform implementation I know of is LyX. Binaries are available for Linux, Mac, and Windows users. LyX can interface with the Maxima computer algebra system. (Just add the path to Maxima in Tools -> Preferences -> Paths.)
An interesting alternative is TeXmacs.
Windows users appear to have a number of commercial choices, the most popular of which seems to be Scientific Notebook and Scientific Word. (Scientific Notebook is not marketed as a LaTeX front end, but as of 2004 it still saves in LaTeX format and with a tiny amount of editing can be used that way.) See Scientific Word user hints.
Mathematica notebooks can also be used as an WYSIWYM interface for mathematical documents.
In the WYSIWYM world, MathML is an obvious alternative to the LaTeX as an underlying document format. (In principle, this should not matter much to a user, who should be able to work in the GUI environment and not worry much about the underlying format.) The Amaya browser/authoring tool enables the WYSIWYM production of mathematical documents, uses MathML as the underlying format. As of 2005, I find Amaya a bit slow and clumsy for the production of mathematics.
The most powerful way to produce mathematics is to learn a markup language for type-setting mathematics. This also provides a big advantage for the process of writing: you get to use your favorite text editor and thereby get access to powerful editing facilities. The most popular choice is LaTeX, which is almost the universal WYSIYM choice among mathematicians, physicists, and economists. It is also my personal choice. An alternative is Lout, which is much less widely used but has some strong advocates. A full Lout installation is remarkably small: the download is less than 2Mb. The math in a Lout source document looks a lot like math in the EQN language. (Speaking of which, some people insist that EQN and GROFF remain the right way to typeset mathematics.)
There are a number of efforts to provide a meta-format from which both LaTeX and XHTML/MathML documents can be generated. The most notable and currently developed is probably GELLMU, although tbook is also interesting. I like the much simpler restructured text (reST), which allows inline and display math in LaTeX format. (See my reST hints.) Citation handling is currently (2005) weak, but bibstuff provides some basic capabilities. Math support is improving. It may also be worth trying reST plus Mozilla's itex for web math. Other metaformat options include: Almost Free Text (AFT), MarkDown, TextTile, and setext.
reST to HTML: just use the rst2html writer. If you have included math in the document, use the rst2mathml writer.
The usual way of creating PDF from an reST document is the following: use the rst2latex writer (or the rst2latexmath writer) to convert the document to LaTeX format, and then use pdftex to produce the PDF.
rst2pdf produces PDF directly using the ReportLab library. Good math handling via Matplotlib's mathtext!
You can also produce HTML with rst2html and then convert it. Using Adobe Acrobat can work moderately well, either by printing from a browser or by directly importing the HTML document. Alternatively, you can use the xhtml2pdf converter (License: GPL or commercial) or the Prince XML converter.
Background: LaTeX is a document formatting package based on TeX. TeX is typesetting software, arguably the best in the world (especially for mathematics). In this section I will concentrate on LaTeX and related resources.
To get started with LaTeX you will need two things: a text editor or IDE, and a LaTeX distribution (such as MikTeX, OzTeX, teTeX, or fptex). Amazingly enough, you can get everything you need for free. You can also get great help from other users, e.g. on comp.text.tex or the MikTeX users list.
AU Students:
For mathematical documents and for long documents (like dissertations!) you should use the LaTeX document preparation system.
There is an AU Thesis Class,
which automatically handles all the formatting of your dissertation or thesis.
Instructions for using this with Scientific Word are included.
Also see MacKichan Software's basic instructions and
detailed instructions.
You can also use this custom document class
with LyX.
That said,
my recommendation is to us Vim with my MiKTeX menus,
or with Vim-LaTeX.
If you are used to word processors, you may initially find the process of creating a LaTeX document a bit clumsy: you do not see the document formatting as you write. However for long documents this is actually an advantage, which you will grow to appreciate. You will create your LaTeX input file with your text editor. In addition to your text, you will add certain LaTeX formatting commands to this input file. You will then use your LaTeX distribution to process this input file, which will produce a device independent (.dvi) file that you can view and print. Details follow.
One caveat:
When you are working on an academic article,
LaTeX is an excellent environment.
But when submission time comes,
you may pick a journal that does not accept LaTeX.
What to do?
i. Article format generally does not matter until acceptance:
hardcopy submissions are still usually expected,
and otherwise PDF is generally acceptable.
So there is really no problem until an article is accepted at such a journal.
ii. Most journals that express a preference either ask for standard LaTeX or ask for common word-processor formats, but even in the latter case LaTeX is usually acceptable.
iii. If you have written an article in LaTeX and it has been accepted by a journal that for some reason will not accept LaTeX,
you can easily convert your article to a different format.
MiKTeX tools have been released for UN*X systems.
MikTeX is currently the most widely used LaTeX distribution on the AU campus. We are usually behind a version or two.
TeX Live provides a comprehensive TeX system for most systems. BaKoMa TeX is an inexpensive distribution for Win95 that got some good press, and it includes PostScript versions of the Computer modern fonts. (A very nice feature.) You can purchase a TeX system (with a lot of other useful stuff) from NTG as 4allTeX.Novices can get acquainted with LaTeX by looking at a tutorial. Once you are using some version of LaTeX, you are likely to find LaTeX: A Document Preparation System by L. Lamport to be indispensable. There are many other good books on TeX and LaTeX. The free lshort2e.pdf has most of what a novice will need. (Check for the most recent version.) More detail can be found in Making TeX Work and many other excellent books. If you need to write your own class (and you probably do not!) try clsguide.pdf.
Users with questions should check the LaTeX FAQ, and the LaTeX homepage. If you are sure you questions are not answered there, ask on the comp.text.tex newsgroup. CTAN and the CTAN-Web, also offer a wealth of information about TeX and LaTeX. (Be sure to visit Graham Williams's catalogue of information.) You may also find some useful TeX Information at UCC. If you get truly ambitious, Victor Eijkhout's TeX by Topic is now available online. (Most users will never need such a detailed understanding of TeX, however.)
Although the LaTeX picture environment is very powerful for basic drawings, you will often need more. Often you will want to produce your graphics as EPS files, which can be included in a LaTeX document. However there are several alternatives.
\usepackage[dvips]{graphicx}
\begin{figure}[htb]
\begin{center}
\includegraphics[width=\textwidth]{mygraphic.eps}
\end{center}
\end{figure}
-dEmbedAllFonts=true.
See this document
for more discussion.
\usepackage[pdftex]{graphicx}\usepackage{epstopdf}.
--shell-escape command line switch.
\includegraphics{filename.eps} as usual to include your EPS graphic,
and pdflatex will conver them to pdf format on the fly.
(Be sure to return the extension! Otherwise you will get conversion the first time,
and use of the old PDF after that.)
You can use flpsed to add editable annotations to a PostScript document. (License: GPL; Platform: X11.)
See the more complete list at http://www.loria.fr/services/tex/english/outils.html.
TeX to PC has a more complete discussion. One interesting possibility is plasTeX, which parses LaTeX for output in various formats. More extensive conversion capabilities may be provided by pandoc. (Language: Haskell; License: GPL)
If you use LyX, there is a LyX (via LaTeX) to OpenOffice format converter. (See the same URL for a Mac front end.)
You will often want to produce PDF files from your .tex files. (The PDF files can be read by anyone with access to a PDF viewer.) I have had excellent results using dvipdfm, which is included in most LaTeX distributions. Many people report excellent results using pdflatex, which is part of most LaTeX distributions. Also see Markus Kuhn's tips on how to use (La)TeX to effectively produce highest-quality PDF files.
Note that a successful translation into HTML or MathML can subsequently be read by any modern word processor. (Of course it will not look as good as in LaTeX!)
A fuller discussion of options can be found in Wiedman on Screen Presentation Tools. Here are some options using reStructuredText.
- rst2pdf http://lateral.netmanagers.com.ar/stories/BBS52.html (Good math handling via Matplotlib's mathtext!) - rst2s5 http://docutils.sourceforge.net/docs/user/slide-shows.html http://docutils.sourceforge.net/docs/user/slide-shows.html http://www.python.org/doc/slideshows/5min-reST-demo.txt - Bruce http://pypi.python.org/pypi/bruce http://sites.google.com/site/r1chardj0n3s/howto (You can embed a Python interpreter in your presentation page!) - rst2odp http://panela.blog-city.com/rst2odp_on_pypi.htm - rst2beamer http://www.agapow.net/programming/python/rst2beamer http://home.cs.siue.edu/~rkrauss/python_website/ - rst2slidy (cannot find it, but here's Slidy: http://www.w3.org/Talks/Tools/Slidy )
Roberto Alsina mentions that if you choose rst2pdf then fancy transitions are hard, handouts have to be another document, there is no way to easily center something vertically, and you need to create different versions for different screen aspect ratios. (On the other hand, everything is in a single file, your PDF can play almost anywhere, and you know exactly how it will look.)
If you know LaTeX, the beamer is great, and you can compile beamer presentation directly with pdftex. (I found getting started with the beamer document class using MiKTeX's pdflatex to be completely painless.) Some people prefer powerdot (which supercedes Prosper). With powerdot you will need to go .tex to .dvi to .ps to .pdf. (Many integrated TeX environments can automatically implement that sequence for you.) Some people like the commercial Utopia presentations bundle.
\setlength{\pdfpagewidth}{11in}
\setlength{\pdfpageheight}{8.5in}
should give you a landscape slide (on screen) in pdflatex. You may
need to specify in AcroRead's print dialog you want the page
rotated to print properly.
If for some reason you feel you must use PowerPoint®, you can insert LaTeX style math by using the TeXPoint plugin. Note too that you can script your PowerPoint presentations using Python: use the win32com module to access the com interface. (Easier than it sounds, as illustrated by some simple examples.)
There are a few open source presentation programs that are not LaTeX based. They are more like using PowerPoint. OpenOffice includes a presentation program. GNOME Office includes Agnubis, but it is still work in progress.
Another simple but powerful possibility. The ReportLab Toolkit includes PythonPoint for presentation creation. It is amazingly powerful, but a bit complex. To make things much easier, you can very simply generate PythonPoint documents from restructured text (reST). Once you have the software installed, this is about as easy as it can get!
S5 [2] can simply create beautiful browser based presentations. Instead of editing HTML you can use reST and convert the text file to a slide show with rst2s5. Also see S5 Reloaded and AJAX-S.
Falling short of a presentation package but still potentially useful for report writing is PyReport, which compiles a Python script and its (textual and graphical) output into a PDF file.
Last but not least: for incredible animated presentations, the technically inclined may consider Slithy.
One place where a good GUI is nice is for the visual formatting of tables. Here a nice GUI can provide a real advantage over markup. This need not mean abadoning LaTeX.
LyX supports table editing. (You can also copy table data from spreadsheets to LyX.)
(Commercial options include Scientific Notebook and possibly LaTable.) When the structure and content of the tables is the dominant consideration, however, LaTeX tables can often be easily and automatically generated. For example, many econometric packages will produce LaTeX formatted tables of results.
If your chosen econometric package does not support LaTeX table generation, you still have a variety of options.
There are extensive citation management resources.
Here are two big factors to consider in making a language choice:
what software in your area is already written in the language,
and how much original coding you will be doing.
For econometrics, the big collections of extant code are in Gauss and MATLAB.
Of these two, Gauss has the advantage of real array broadcasting,
while MATLAB relies on the clumsy repmat and bsxfun for broadcasting.
Neither language is truly object oriented.
(Gauss has structs; MATLAB has some object-oriented functionality.)
If you are going to write a lot of your own code,
object orientation becomes critical.
You can get this very nicely with the NumPy Python library.
If you are forced to work in Matlab you can still have access to Python via pymex,
which "embeds a Python interpreter into Matlab".
Being able to write code in one matrix programming language and run it in another environment is desirable. Examples include Treiber's pym Python program for converting MATLAB to Python, Rookley's gtoml Perl program for converting Gauss code to Matlab, and Christopher Stawarz's i2py script for coverting IDL to Python. If you want to create a translator, consider PLY (a Python implementation of lex and yacc).
NumPy is one reason why Python rocks for research.
My favorite approach to matrix (and multi-dimesional array) programming is NumPy (License: BSD; depednecy: Python). This is a Python package (but it is very fast because it is written as a C extension). This means you can have full access to the ease of use and to the object-oriented power of the Python programming language while doing serious scientific programming. Very high quality. Additionally, a reasonably complete scientific computing environment is provided by SciPy. (License: BSD; Dependency: NumPy.) To complete this scientific computing environment, add the extraordinarily high quality graphics package Matplotlib. (License: BSD; Dependency: NumPy.)
You can find everything packaged together for a single install. For example: NumPy, SciPy, and Matplotlib are included in the Enthought Python distribution, along with many other useful packages. (Warning for Idle users: idle-script.py was missing from EPD release 7.1-1; this was fixed in subsequent releases.)
Many scientific programming applications can be found on the SciPy Topical Software Wiki. ScientificPython offers some useful scientific and visualization modules. The are also some additional probability and statistics utilities available. Pycoin provides a Python interface to some of the COIN operations research packages. Additional functionality can be obtained from the NAGpy interface to the NAG Fortran library or the PY-ML interface to Mathematica. Python also has modules for interacting with gnuplot and R. You may also want to see the Python math tools at the Vaults of Parnassus. If you need to build GUIs as part of your Python project, consider the Boa Constructor. Additional Python stuff you might find useful for scientific computing: PAIDA (a Python implementation of the AIDA abstract interface for data analysis), and the resources listed at StatPy, and possibly various AI resources. Modular toolkit for Data Processing (MDP) is a Python data processing library implementing Principal Component Analysis (PCA), Independent Component Analysis (ICA), Slow Feature Analysis (SFA), and Growing Neural Gas (GNG). Finally, it is worth poking around CheeseShop.
GAUSS probably remains the first choice among U.S. econometricians. It is known for speed and ease of use. Its collection of built-in statistical procedures is not as extensive as specialty languages such as S-Plus/Gnu-S, but this can be offset by its speed and by available free and commercial packages (such as GAUSSX).
The GAUSS Source Code Archive at American University is a primary source of GAUSS freeware. Included in the archive is a partial list of other archived code. You may also find it useful to visit the archive for the gaussians mailing list.
Jens Peter Steffen offers a detailed comparison of GAUSS with MatLab and Ox.
Available in Hurst Lab and Kogod/Econ Lab.)
(Available on the AU campus as a network application.)
There is online documentation. Check out the MathWorks software library for MatLab. You may also want to visit the Matlab Users Group. MathTools Ltd offers free Matlab toolboxes, Matlab resources and links, MIDEVA (fast Matlab replacement), and the MATCOM compiler for Matlab. If you want Matlab's numerics but need to work in a real programming language, you can control a Matlab session from Python with mlabwrap.This is a very short selection of possibly useful free programming languages.
If your emphasis is computational, you will want to visit NIST's Guide to Available Mathematical Software and the Netlib repository. Also, see Jack and Hatem's list of free linear algebra software.
I use Python whenever possible, which is almost always. (The main exception is when execution speed is at an absolute premium in computationally intensive projects.) Traditionally thought of as a scripting language, Python has evolved into an extremely powerful very high level general purpose programming language. It is still useful (indeed, a first choice) for scripting. Use it to find out why. In addition, Python has excellent support for scientific computing. The online documentation is excellent. If you lack programming experience, try Python for the Absolute Beginner and Byte of Python before trying the Python tutorial.
One other note: although it is an interpreted language, you can compile Python. Interesting graphics and numerical libraries have been developed for Python.
L3 is a large subset of Python along with a GUI interface that provides a "worksheet" like environment. (License: BSD.) Easy and powerful.
For scripting,
the most popular choices currently seem to be Python,
Perl,
and Ruby.
There have also been some interesting applications of the embeddable S-Lang interpreter and programmers library.
Lua is especially small and portable,
and is used in the up and coming LuaTeX extension of pdfTeX.
(See my LuaTeX hints.)
It is also worth mention that Jython implements Python as Java,
allowing the ease of Python scripting to be combined with the power of Java.
(As a very cool plus,
Vim supports scripting with Perl, Python, and Ruby.)
More Scripting:
Active Perl is available for many platforms and is getting excellent reviews.
Python is growing in popularity,
as is Ruby
(which finally has a Windows installer).
We have alread discussed C above. Certainly C++ and Fortran have to be mentioned. The GNU Compiler Collection (GCC) includes front ends and libraries for these (as well as Objective-C, Java, and Ada).
Getting started with Java:
Download the Java Development Kit (JDK),
which includes the Java Runtime Environment (JRE).
On Windows, you install this by running the downloaded executable.
Then download Eclipse,
which is an IDE that is popular for Java development.
You “install” Eclipse simply by decompressing it.
(E.g., on Windows, just unzip it.
It does not make any registry changes.)
Eclipse comes with tutorials.
For a simple overview of installation,
consider this online video.
For very simple introductions to Java (suitable for those without programming skills), try David Eck’s free book and/or Java Programming for Kids, Parents, and Grandparents.
The F
programming language is a carefully selected
subset of the most useful Fortran 95.
You can compile F with the g95 compiler:
g95 -std=F my_program.f95,
available for free from G95.
FreePascal includes very substantial Delphi compatibility. (License: LGPL and GPL)
Ada, which is a preferred languge for the security conscious.
Eiffel supports desing by contract. There is now open source licensing of Eiffel Studio. (License: GPL)
Scheme.
MzScheme is a free and open source implementation for Linux, Mac, and Windows.
(As a very cool plus,
as of version 7 Vim supports MzScheme scripting.)
Scheme, and R. Kent Dybvig's The Scheme Programming Language, Second Edition is now online.
Sather-K is Eiffel based but adds innovations (and is free).
Visual Eiffel Lite is free. Documentation is in Eiffel: Object Oriented Programming
Salasaga is "an Integrated Development Environment for producing eLearning". Roughly, it's an open source IDE for producing interactive web pages. (License: LGPL)
GhostScript and GhostView let you view and print PostScript files.
Related: PLisp takes the basic structure of Common Lisp and uses it as an alternative representation of a PostScript program.
While the basic graphic operators of PostScript are retained, Lisp-like function definition, control flow,
and variable binding become available.
Macros, defined constants, and function libraries have also been provided.
The PLisp compiler generates PostScript code which is guaranteed not to contain errors in stack usage.
In an interesting twist, you can now use PostScript as a drawing language in web pages using WPS, "a PostScript and PDF interpreter for HTML 5 canvas".
See the free stat software pages by John C. Pezzullo and Gene Shackman . (The latter offers some package comparisons.) Also see the QM&RBC Software page.
Resources in this area are extensive. I will only mention a few idiosyncratically selected items. (For linear and non-linear programming, see also the separate list of solvers.) Do not forget to think about scaling issues. (Here is one discussion of scaling: go to the Aptech web site, click on Resource Library, then click on White Papers, and download Optimization with the Quasi-Newton Method.)
Visual analysis of data remains very useful,
and some innovations in this area are recent.
Classic texts include:
The Visual Display of Quantitative Information by Edward Tufte
and
Visualizing Data by William S. Cleveland.
You can get the data and S scripts for Cleveland's book.
Cleveland (with Becker and Shyu) developed Trellis Graphics™ for data visualization,
which has been implemented for a number of platforms including S-Plus and R.
(The name “Trellis” is trade-marked, so these are often referred to as lattice plots.)
Other resources:
Daniel Carr's page.
Modrian "is a statistical data-visualization system written in JAVA." Good for categorical data and for maps. Plots are interactive.
You will find a more complete list plus discussions at SymbolicNet and at the University of Haifa Math Department. SAL (Scientific Applications on Linux) offers a useful review of Computer Algebra Systems. Below I list only a few interesting packages, with an emphasis on multi-platform general-purpose packages.
Commercial packages include the best known, Mathematica and Maple, and some excellent but less well know packages such as LiveMath.
Groups, Algorithms, Programming (GAP) "is a system for computational discrete algebra, with particular emphasis on Computational Group Theory." (License: GPL2)
There are a number of way to provide access to nicely formatted math on the Web. The most widely used is to provide PDF documents that contain nicely formatted math. The best way to produce good looking math in PDF documents is with TeX based software. Acceptable results can sometimes be achieved by distilling a word processor document with equation editor objects embedded in it.
The other major alternative is to produce MathML,
which is finally starting to get decent browser support (especially in FireFox).
(Be sure to download the STIX fonts.)
Producing MathML by hand is impractical,
so there has been a search for feasible ways to rely on MathML.
One of the most interesting approaches is to use reStructuredText
with the rst2mathml writer.
This is probably the simplest powerful way to put math on the web.
Another interesting approache is ASCIIMathML,
which simply includes LaTeX-like math in a normal HTML file.
(A clever javascript produces the MathML.)
Mozilla based browsers have excellent native MathML support,
so they work well with ASCIIMathML.
(But you need to install the math fonts.
Opera through version 7.5 provides no MathML support beyond entities, so it does not display ASCIIMathML.
IE version 6 requires MathPlayer to work with any MathML.
A "two-step" alternative is the Mozilla project's Itex2mml.
This embeds a simplified TeX notation in HTML files and then processes them to produce XHTML files containing appropriate MathML in place of the TeX.
The remaining alternative is to convert LaTeX documents directly to XHTML+MathML documents. This can be done with TeX4ht or with the closely related TeX4moz. TtM looks like a similar effort.
I like two browsers: FireFox and Opera. I have been hearing some good things about Chrome (mostly speed related). At version 8, Internet Explorer is finally usable with limited CSS, but still radically fails the Acid tests, and still lacks support of SVG graphics, MathML, and even simple XHTML. So, do not use IE unless required by your workplace, and then prepare to suffer. An interesting "new kid on the block" is uzbl, which emphasizes speedy browsing but is highly extensible.
If you want to test your browser for standards compliance, start with the Acid 3 tests. You might also want to look at handling of MathMl, SVG graphics, or even a very simple XHTML. (Be sure to look at the tests where the document is served as XML.)
Opera is relatively small, very fast, extremely reliable, W3C-standards oriented, available on many platforms, and has a fully functional free version. (See the Opera hints below.) Last I looked, it did best on the Acid 3 tests. FireFox (based on Mozilla) is a free-and-open-source, cross-platform browser that emphasizes the support of open standards. FireFox is currently (2004) the only browser with native MathML support. (See the FireFox hints below.) A Windows-specific implementation of the mozilla rendering engine is K-Meleon, which gets rave reviews. Google's Chrome browser is getting good reviews for speed and design. A "freeware" browser for Windows that relies on the IE rendering engine is CrazyBrowser, which provides functionality beyond IE (e.g., tabbed browsing even for those with IE6). A "donation ware" browser for Windows that relies on the IE rendering engine is MyIE2. If speed and information are your primary concerns you might consider a text browser such as ELinks or the venerable Lynx. (There is a Win32 port.) For Windows, Off By One looks like an interesting, light-weight option. You can find a useful browser list at LibPNG.
Request:
Please follow basic email etiquette [1|2],
especially by using only ASCII text for your email and by quoting selectively and only as necessary to provide context for your reply.
Finally, if you must use Outlook,
do your interlocutors the courtesy of turning off TNEF attachments!
Get a decent email client. Since there are so many good options, choose an email client that has a multi-platform presence and, most importantly, lets you use your own editor.
Suggestion:
Using your own editor will repay you handsomely, saving time and frustration.
Here are examples of things any good editor will allow you to do simply.
Preprocess your email to compensate for bad practices by the sender,
delete or reformat blocks of text (e.g., a line, a sentence, or a paragraph) without reaching for a mouse,
adjust capitalization (e.g., change caps to lower case or vice versa, or convert to first letter caps),
and quickly insert text from any other file (i.e., read it in, so you do not need to cut and paste).
One could propose that every application in which you need to edit text should include such facilities.
E.g., there are many email clients with built in editors that have many such facilities.
But then each time you change applications you will have to learn a new editing environment.
Instead, whenver possible, you should use applications that provide support for an external text editor.
By sticking with your preferred editor you do not have to learn a new editing environment and scripting language each time you switch applications.
That of course is the point of modularity.
See the Mahogany hints, Thunderbird hints, and Alpine hints below.
Another cross platform solution is now The Mutt Email Client—long popular among Unix users, and available to Windows users. (You can also get mutt along with fetchmail, and sSMTP in a unix-mail package for Windows, but you'll have to install Perl and Cygwin.) Kaufman's Mail Warrior is free, full-featured, and relatively small (for Windows users). Poco also has many enthusiasts, and it is standards oriented and security aware. An email client that is not free but gets great reviews is The Bat, and rumor has it that the next release will finally support external editors. Another popular commercial email client is Mulberry, and it is available on many platforms. One last note on email: if you are enlightened enough to use Vim as your editor, you might consider using vimail, a simple mail reader for Vim.If you want to play with developing an email client, Python-based Mamma Mua is off to a good start but could use some development.
If you are in an environment that forces you to use Outlook, you can at least write your email with a decent editor.
POPFile sorts your email and filters spam. It is free and cross platform.
Gotmail can (roughly speaking) pop your mail off a hotmail account. MrPostman can do the same for hotmail and Yahoo accounts, and it can be extended to work with other services. (GMail includes good POP+SMTP as free services, and offers good directions for configuring Thunderbird to use them.)
Basic email etiquette:
Courtesy almost always requires turning off HTML mail.
You need to turn off HTML mail for almost all professional interactions,
and especially if you post to mailing lists or newsgroups.
Comment to AU students: Why use webmail?
AU supports IMAP, which also allows you to keep all your mail on the campus servers.
You can use any IMAP email client.
I recommend Mahogany, but you can use Outlook or Netscape mail.
(You have to have your mail set to IMAP;
e-academics will tell you how;
you can reach them at 202.885.2550.)
Note that webmail will remain available to you,
should you ever need it.
If you must use webmail you should turn off HTML formatting.
For a single new message you can click on Format and then select the "plain text" option.
Better yet, alter your preferences to pick plain text as the default format.
Click on the "Preferences" tab (next to "Help" at the top right),
and in the dialogue box that opens,
choose the "Plain text" default editor and set "Send message in this format" to "Plain text."
What are some good document formats, and how can one transform between them?
For writing math, nothing beats LaTeX. However, you can use reStructuredText with writers that support math to produce both LaTeX and XHTML MathML.
Writing HTML is easy: learn the basics. Conversion to other formats is possible. Most word processors will read HTML and automatically convert to their own format. You can also convert HTML to PostScript (if you have access to Perl).
After learning a few HTML basics, you can learn much more from the materials at the World Wide Web Consortium W3C). Most of the time you should be able to use XHTML Basic and Cascading Style Sheets (CSS). Here is some CSS Background, and the wonderful chapter 1 of Cascading Style Sheets 2.0 Programmer's Reference by Eric A. Meyer. For more information and links, go to the HyperText Markup Language (HTML) Homepage. Some authors may like to see the ISO standard as well.
All modern Word Processors can export their documents as HTML: unfortunately, they often produce pretty bad HTML. You can get much better results with some of the HTML editors, such as the web development suite offered free by Evrsoft
XHTML is a wonderful HTML related markup which provides for most needs when used with CSS. Unfortunately some browsers do not support it, unless you serve it as HTML. (That is the trick used in the present document.) Some authors discourage this practice, but it should work fine, as long as you validate your documents.
XHTML: Introduction to XHTML, with eXamples" helpful | XHTML validation. With XML/XHTML (handled by an XML processor) you will be able to define your own entities in the doctype declaration. E.g., you could define <!ENTITY alpha "&#xxxx;" > (where xxxx = the numeric reference) to get around remembering numeric references. The XHTML+MathML document type looks particularly useful, and it is already used to provide math support in reStructuredText.
Mathematical Markup Language (MathML) is now a wonderful reality. FireFox and other Mozilla based browsers offer native support. So does E-Lite: ICESoft's lightweight Java web browser offers full, native MathML implementation. Internet Explorer browsers currently support it only via plug-ins. Public discussion on features for math in HTML contexts takes place on www-math@w3.org. To subscribe send a message to www-math-request@w3.org with "subscribe" as the content of the subject. There is a public archive. Also, consider WebEQ for Web math.
XML:
Perhaps the most interesting current XML development for non-programmers is
OpenDocument Format (ODF).
The is a promising open document exchange standard.
Move the world to an open, fully-documented, royalty-free standard for document exchange!
OpenOffice is currently the only office suite supporting the OpenDocument Format,
but there is also a plug-in converter for MS Word (TM).
By the way, docutils can write to ODF:
see Dave Kuhlman's work (currently in the docutils sandbox).
What is that winmail.dat attachment you just got in your email? It is a proprietary Microsoft format that bundles together multiple attachments in a way that most email clients cannot unbundle. How obnoxious! So, what can you do about it?
One possibility: ask your interlocutor for the simple courtesy of turning off TNEF attachments! (Instructions are the bottom of the article.)
If you are unfortunate enough to receive a TNEF attachment from someone who cannot figure out how to configure their email client to send attachments that everyone can read, you may have to unpack the TNEF attachment yourself. The only cross platform solutions I know of are JTNEF and pytnef (License: LGPL). At this point, pytnef relies on the tnef command-line utility that is I think only available for unices (although it looks like it could be compiled for Windows).
If you need to produce email in a scripting environment, Python offers all the basics in the smtplib module. You can even add MIME attachments with reasonable ease.
Cross platform: Pan (GPL) or slrn or Gnus.
Free for Windows: Xnews and Forté Free Agent.
First let me offer an apparently outrageous suggestion: individual users can often substitute good habits for AV software, and even if you install AV software these good habits are crucial defenses. That said, whatever software you choose, you may wish to test it on the EICAR test file.
TO AVOID SENDING AND RECEIVING VIRUSES:
SENDING
i. use plain text to send and receive
information whenever possible.
All word processors and spread sheets
can save as .txt.
There is almost never an excuse for using
anything except plain text for email.
ii. When plain text is not possible
(because special formatting is required)
you can almost always use HTML.
All modern word processors
and spread sheets can save as HTML.
This is almost risk free, but to be
really safe you can turn off Java and
JavaScript in your browser preferences.
iii. When page formatting is crucial,
which it almost never is,
use Adobe's PDF format.
You may need a PDF "printer driver" to do this
(such as Adobe Acrobat, Jaws, or some free alternatives such as PDFCreator).
RECEIVING:
i. Most viruses are received as part of email attachments.
Many viruses (more accurately known as worms) will email
themselves from an infected computer to hundreds of others.
So the most important thing you can do is not open any
email attachments. Of course, sometimes we need to open
attachments.
ii. If you must open an attachment, view the file extension.
The default in Windows is to turn off your ability to do this,
which means you can be tricked into thinking a dangerous
Visual Basic script filename.jpg.vbs
is really a safe .jpg file.
You can fix by following this windows hint.
Especially dangerous extensions are .exe, .com, .pif, .vbs.
Also dangerous are .doc and .xls.
(Comment: dangerous file types can be included as ``attachments'' to .pdf files as well,
which means you should not open such attachments with Adobe Acrobat either.)
iii. Never send or receive anything
in proprietary formats (such as Word or Excel). Related to this,
never use Outlook unless you know
how to turn off all its dangerous features.
And if you simply must open a document
in a MS format (e.g., because that's what
a work colleague sent you), learn how to
turn off the availability of macros.
You should also be cautious with any other
format that supports macros, which basically
means you should avoid exchanging information
in word processor formats (see i. and ii. above).
iii. Never run a program file unless you
know it came from an impeccable source.
(This includes file extenstions .exe, .com, .pif, .bat, and .vbs.)
iv. Never leave some elses floppy disk in
your computer. (I once got a virus when a
power fluctuation caused my computer to reboot
while I had a virus infected disk in my A: drive.)
Additional Comment: Refraining from sending word processing files is a basic courtesy that you should extend whenever possible. Even if you know how to use an anti-virus program, this means only that you know how to look for *known* viruses. New viruses remain a problem.
In addition, during document exchange, you *cannot* remove the questions in the recipients mind about your thoroughness even in this regard. (E.g., did you remember to check this time, which program did you use and how good is it, when did you last update the virus definitions, etc.) If you send text (or straight HTML, if formatting is a concern) this anxiety is completely eliminated. This is a simple courtesy, since all modern word processors make exporting as ASCII text or as HTML very simple. Furthermore, if the recipient wishes to read what you send in their word processor, all modern word processors also import ASCII text and HTML very simply. In sum, there is almost never an excuse to send someone anything except ASCII text or HTML, unless it is required by the rules of your workplace.
Since this is not a core interest of mine, I list only a couple resources.
Attention Vista users: your operating system came without the Windows Media Player plugin. Fortunately, mozillaZine explains how to install the WMP plugin.
The modeling languages most widely used by economists are commercial: GAMS and GEMPACK. Economists use these primarily for CGE modeling. (For GAMS there is online documenation; also helpful CGE exercises with solutions.)
Other alternatives are listed at http://plato.la.asu.edu/topics/tools.html. A few are listed below.
Naturally, many commercial modeling languages come with a variety of solvers. Here are some other solvers.
For Python, PyScripter has an excellent reputation. But it has limited support for threading. (Windows only; license unknown.)
For Java, consider the Eclipse IDE. (Eclipse is a "general purpose" IDE.) Python users can also use Eclipse via the Pydev plugin.
For C and C++, consider the Agide IDE. You can use Vim as your editor! On Linux/KDE, you can alternatively use KDevelop, which also support Vim as an editor.
VimMate is a light GTK-based IDE that embeds the Vim editor.
For Python:
- the general purpose Leo IDE includes a unique and powerful outlining facility
- the relatively lightweight Eric3 IDE gets very good reviews.
Python is an obvious choice for server side scripting. You might consider Xitami as a cross platform server solution, or simply to test your scripts.
The obvious language independent FOSS choices currently (2005) seem to be TK and wxWindows, with TK being simpler, more mature, and a bit slower and wxWindows being faster and more powerful but less stable. Of course Java provides a language dependent solution.
Python comes with the Tkinter module, which provides a Python interface to the TK graphical user interface (GUI). Tkinter documentation is spread around. For a very brief introduction, you can try Alan Gauld's tutorial. If you use Tkinter, consider using Python megawidgits (Pmw). (You can also easily add graphing extensions with BLT Toolkit. You may want to also get Mark Rivers's enhancements.
tk_happy allows very fast, menu guided tkinter GUI creation.
Until recently curses has been unavailable for Windows. Wcurses is a curses module for Python that works under Windows. There may also be some profit in considering curses applications on INTERIX.
wxWidgets offers cross-platform API (C++ library) for writing GUI applications. wxPython is a Python extension module that wraps wxWidgets. Dabo is a cross-platform application development framework, written in Python atop the wxPython GUI toolkit. (Dabo capabilities resemble Visual Basic or Visual FoxPro, but it's cross platform.)
There is some useful background on the PyMol wiki. The Los Alamos National Laboratory Information Architecture offers a useful white paper on graphics formats.
Encapsulated PostScript (EPS) remains the universal standard for graphics inclusion in journals and books. (In some applications, it is being challenged by Adobe's Portable Document Format (PDF). It therefore pays to learn a drawing application or language that allows you to generate encapsulated PostScript (EPS).
Currently the best choice for web graphics. (GIF and JPEG suffer patent problems, although these patents are finally expiring.) Before placing graphics on the Web, visit the Portable Network Graphics (PNG) homesite.
MNG and APNG
The animated version of PNG is called
MNG, for Multiple-image Network Graphics.
It supports looping (including nested loops),
clipping, deltas, and other features, plus
everything PNG supports-- including alpha
transparency.
Unfortunately implementations have been lagging.
However FireFox supports the animated PNG (APNG) format,
which is less complete but quite capable.
SVG
A rising format for web graphics and may already be useful if you need vector graphics and/or animation.
You can convert EPS to PNG or SVG.
(See below.)
It is possible to embed SVG in PDF.
For extensive SVG manipulation and generation tools,
see Batik.
Scalable Vector Graphics is a royalty free vector graphics standard for the Web,
and it is a powerful animation format.
(If you have simple, static graphics to produce, you might write them in PostScript and then translate using pstoedit.)
One of many nice things about SVG is that it can be embedded into PDF,
animations and all!
(See this very cool example.
Here is a perl script.
Here is a Java converter.
Here is a Python script.
(If you can find Leonard Rosenthol's Acrobat plug-in, let me know.
It seems to have disappeared.)
Another nice thing is that you can move image generation to the client side.
Browser support for SVG:
Opera and FireFox
have native support.
(FireFox reports the current status of SVG support.)
IE 7 is badly lagging:
you must use a plug-in (such as Adobe SVG viewer.
(Other SVG viewers are available.)
If you care about IE users,
you can provide a back-up PNG..
(IE's PNG support is buggy too; oh well.)
With all the point and click drawing applications currently available, why bother with a drawing language? The answers are generally precision, speed, and fun, often in that order. This section concentrates on 2-D drawing, with emphasis on the PostScript drawing language, while mentioning a few other interesting possibilities.
PostScript is a very useful device independent page description language. If you want to precisely render a vector graphic, you may well find it convenient to draw it yourself in PostScript. See some PostScript hints below.
3D drawing: For simplicity and power, it will be hard to beat Sketch. (Langauge: C++ (binaries available); License GPL) Particularly helpful to LaTeX users is its support of tikz. (See Kjell Magne Fauske's nice introduction to Sketch, which includes full examples.)
Try the Persistence of Vision Ray Tracer (POV-Ray). If you need high performance real-time 3D, consider Irrlicht. If you are an OpenGL user, superficie may be useful, although development appears quiescent. (License: GPL)
3D plotting: For nice, accurate surface plots, there is probably no simpler solution than gnuplot. The SymPy plotting module is very interesting. QwtPlot3D appears very powerful, and PyQwt3D provides bindings for Python users who wish to produce scientific 3D plots. (Now supports NumPy arrays.). Other possibilities include Visual Python and Python Computer Graphics Kit. Also, OpenDX looks like a very powerful open source implementation of the IBM Data Explorer (DX), and there is also a Python binding. VisIt looks to be an extremely powerful way to produce 3D animations.
The Visualization Toolkit (VTK)
"software system for 3D computer graphics, image processing, and visualization"
consisting of "a C++ class library, and several interpreted interface layers including Tcl/Tk, Java, and Python."
(License: BSD-like, but containing some patented technology.)
Hint: Find yourself a good interface to VTK.
VTK provides wrappers for Python, Tcl, and Java, but the wrappers resemble VTK more than the supported language.
Python users may like MayaVi,
but this still requires VTK knowledge.
For true ease of use, consider Enthought's mlab Python framework for access and manipulation of MayaVi2 objects.
(Also note that PyVTK can write VTK files from NumPy data.
TVTK provides a powerful and "Pythonic" interface to the Visualization Toolkit.
With some feature resemblance to MayaVi,
the possibly more powerful Paraview is written in Tcl/Tk rather than Python.
More 3D plotting solutions:
HippoDraw produces interactive graphics for data analysis.
Simon Yuill offers a nice animation tutorial (with a Python emphasis).
Pms.Blt provides a Python interface to the BLT Graph plotting library.
mencoder mf://*.png -mf type=png:w=600:h=500:fps=10 -ovc lavc -lavcopts vcodec=wmv2 -oac copy -o animation.avi
or like this
mencoder 'mf://*.png' -mf type=png:fps=12 -ovc lavc -lavcopts vcodec=mpeg4 -o animation.avi
.)
If you have mpeg2encode,
this can also be done with ImageMagick,
try convert -delay 20 c:/myimages/img*.png c:/myvideo/imgs.mpg.
ffmpeg -b 8000 -f mpeg2video -r 30 -i frame%03d.png movie.mpeg.
You can also produce an AVI like this:
ffmpeg -r 10 -i frame%03d.png -f avi -vcodec msmpeg4v2 -y movie.avi.
Works great!
Note that AVI support very low framerates; MPEG does not.
(Windows users are fortunate that celtic_druid has been compiling fairly up-to-date Windows binaries.)
Blender supports powerful 3D drawing and animation, which can be assisted by Python scripts.
HarddiskOgg can record analog audio "directly to Ogg Vorbis/MP3/Wave with on-the-fly normalization". (License: GPL)
HTML % includes a VIDEO element, supported by FireFox 3.5+ and Chrome 3.0+. (See Video For Everybody for usage hints.) This enables native OGG/Theora video playback in Firefox 3.5! For conversion of video formats, you might try HandBrake. (License: GPL)
See the SciPy TopicalSoftware Wiki for a more complete list of options.
pyplot module provides quick-and-easy MATLAB-like graphing functionality.
For finer grained control, you may prefer Matplotlib's object-oriented API.
Matplotlib can save to a variety of formats,
including SVG (which you can then manipulate with Inkscape).
See the Matplotlib hints below.
The cross-platform standard for graphics is Encapsulated PostScript (EPS). EPS is generally the expected graphics format by publishers (e.g., when you submit drawings for a book or journal article). The most common file conversion problem is therefore taking a file produced in a different format and converting it to EPS.
PNG is the current standard for web images. If you have produced an image for the web in a different format, see the LibPNG list of converters.
GhostScript can convert many file formats, including PS to PDF. You can combine GhostScript with the Redirection Port Monitor (RedMon) to produce PDF files (see helpful directions). FreeDist is a Visual Basic program can automate this process for Windows users. FreePDF seems to offer similar functionality to FreeDist. PDF995 is another free (gratis) but not open source alternative.
If you need to convert entire HTML documents to PDF, try HTMLDOC. Perl users can try html2ps and then use GhostScript. If your document is well formed XML, CSSToXSLFO offers very interesting possibility. It converts an XML document, together with a CSS2 style sheet, into an XSL-FO document. The document "can then be converted into PDF, PostScript, etc. with an XSL-FO-processor", which is included. (License: Public Domain)
There is an almost limitless variety of high quality commercial drawing applications with pricing roughly linked to functionality. Rather than attempt to list or compare those, I will focus on a few cross-platform alternatives.
Python users have a number of fine alternatives. For serious 2-D drawing, I like PyX very much. PyX also has some support for 3D graphics. (See my PyX hints below.)
While PyX is great for data-based graphs, I often find myself using Matplotlib for these. (Matplotlib is a wonderful 2-D plotting package which also supports powerful interactive graphics.) PyX and Matplotlib support the generation of EPS and PDF plots with LaTeX text. (Additionally, Matplotlib provides an impressive mathtext capability independent of LaTeX.)
Matplotlib and Pyx currently take different approaches to math text. PyX uses LaTeX to typeset the math, so you must have a working LaTeX installation. Also, Pyx generates only PostScript and PDF graphics with this approach. Matplotlib uses its own parser and layout engine to typeset math text with Type 1 computer modern fonts. You do not get the full power of TeX typesetting, but you can produce outputs in a variety of formats (including EPS and PNG). Here are some details.
Matplotlib supports spark graphs (sparklines) via the sparkplot module. (Sparklines can also be produced with PIL using the Sparkline Generator Web Application.)
Other possibilities:
Asymptote is a powerful and popular language for drawing 2D and 3D graphs.
The syntax resembles Metapost.
Support LaTeX typesetting of labels.
Asymptote allows easy generation of animations (animated GIFs and MPEGs)!
(License: GPL 3.0)
Kiva
"is a multi-platform Display PDF 2D drawing engine that supports multiple output backends, including wxWidgets on Windows, GTK, and Carbon, a variety of raster image formats, PDF, and Postscript."
(Requires ReportLab for PDF output.)
PyChart is excellent for quick, simple, flexible charts.
DISLIN is free for non-commercial use and is available as Python extensions.
VUESZ is a PyQT based scientific plotting package.
Eukleides is an amazing Euclidean drawing language that can save your drawings as pstricks or in EPS format. It is designed to be very natural for geometric thinking. Sadly it is so far for Unix only.
Graphviz is an open source package with special abilities in drawing directed (via dot) and undirected (via neato) graphs.
The focus is on Graph Visualization.
pydot provides a Python interface to dot.
yED is a
"powerful graph editor that is written entirely in the Java programming language. It can be used to quickly and effectively generate drawings and to apply automatic layouts to a range of different diagrams and networks."
Artdraw may prove promising: it is a PostScript-like syntax that adds alpha blending.
If you are considering PostScript graphics on the way to PDF documents, is worth noting that ReportLab allows direct creation of PDF graphics and reports.
Before exploring other possibilities,
try gnuplot:
it meets many data driven or function driven plotting needs.
It is free and open source, multiplatform, very fast, and very powerful.
(There is a Mac version,
and here are some instructions for installing under OSX.)
You can download official release.
New users may profit from Langlais's "short course"
or
the IBM tutorial.
Features: In addition to plotting 2-D and 3-D graphs of arbitrary functions,
gnuplot can also quickly plot large data sets.
It has a powerful yet intuitive scripting language.
GNUPLOT can provide output in many different formats,
including the LaTeX picture environment and EPS.
The LaTeX and epslatex output "terminals" allow for math symbols etc.
(After LaTeXing the resulting .tex file, the .dvi file can be converted to PostScript using dvips -o.
The Ghostview previewer can then be used to convert the PostScript file,
fonts and all,
to EPS.)
All told this is quite a powerful plotting tool with extremely flexible output.
New users should read Introduction to GnuPlot,
but skip the institution specific material on starting gnuplot and head straight for the "Simple Example".
See the gnuplot hints below.
See Ed Pegg's page for a more extensive discussion.
Edward Tufte offers an online discussion of sparklines.
sparkplot.py creates sparkplots using Python and Matplotlib.
import Image, ImageDraw
import StringIO
import urllib
def plot_sparkline(results):
"""Returns a sparkline image as a data: URI.
The source data is a list of values between
0 and 100. Values greater than 95
are displayed in red, otherwise they are displayed
in green"""
im = Image.new("RGB", (len(results)*2, 15), 'white')
draw = ImageDraw.Draw(im)
for (r, i) in zip(results, range(0, len(results)*2, 2)):
color = (r > 50) and "red" or "gray"
draw.line((i, im.size[1]-r/10-4, i, (im.size[1]-r/10)), fill=color)
del draw
f = StringIO.StringIO()
im.save(f, "PNG")
return 'data:image/png,' + urllib.quote(f.getvalue())
if __name__ == "__main__":
import random
html = """
<html>
<body>
<p>Does my sparkline
<img src="%s">
fit in a nice paragraph of text?
</p>
</body>
</html>"""
print html % plot_sparkline([random.randint(0, 100) for i in range(30)])
If you produce documents in LaTeX, you would naturally like the fonts and equations in your graphics to match those in your text. There are a variety of solutions.
For great results even in complex drawings, try the PyX graphics package for Python. This will require a bit of learning initially, but the results (as EPS or PDF) are fabulous.
Some solutions require the use of PostScript.
\begin{figure}
\psfrag{sintheta}{$\sin(\theta_k)$}
\includegraphics[width=5cm]{myfig.eps}
\end{figure}
Laptop (and cell phone) theft is a constant problem. The Prey Project offers a multiplatform, FOSS theft recovery tool. It uses Google geo location and a web camera if available, and is available for the Android operating system. (A related commercial product is Undercover by Orbicule, which has additional functionality and is very user friendly.) Here are some other possible steps to take. You can run autossh as a service that creates a link between your home router and laptop. Then whenever your laptop has internet, you can ssh into it from home. You can also install a keylogger and schedule (e.g., with launchd or cron) to say sftp the log every day and then restart the log file. (Personally I would only use open source keyloggers, such as PyKeylogger, but these tend to be less focused on hiding themselves.) Probably better than any of this is vigilant use of a laptop cable lock.
Quantum GIS is an extensible geographic information system. (License: GPL)
Planning an open access journal (business models, tips, etc.). Software to create and manage online open access repositories for articles: Eprints (from Southampton University, perl); DSpace (from MIT, java); CDSWare (from CERN, python); FEDORA (from Cornell and U. of Virginia, java). Also: Copernicus is a company specializing in the publication of open access journals.
Windows keyboards are a painful design for touch typists. Consider Happy Hacker Lite II, which unfortunately is a bit pricey. Short of that, at least remap the prominent caps-lock key to something useful: [1 | 2 ]
Touch typing will speed your writing and programming immensely. I know of two free cross-platform solutions. Tux Typing is targeted to kids but is generally useful. Vim users can use the TTCoach script.
Cross-platform PIMs Chandler, which is very promising. (License: Apache. Language: Python.) Also look at Aethera. In the meantime, the Palm Desktop is free, available on Windows and Mac, and quite functional (although it does not use the iCalendar standard).
Citadel is a promising groupware application.
There are lots of good calendars out there. But if you are "always connected" I have not been able to beat Google Calendar. (I have not tried to use it offline.) Note that you can add Google Calendar to your FireFox sidebar. Comment: if you ever see a corrupted screen when viewing Google Calendar, try clearing your browser's cache and cookies.
Generally it seems a good idea that your calendar support the iCalendar standard. (This means you can easily move it between applications and across platforms.) It also means you can easily write scripts that interact with your calendar. For example, you can use the iCalendar. (License: LGPL; Language: Python.) An alternative is the Python-PDI library for personal data interchange, which also handles the vCard format. (License: GPL; Language: Python.) Aside: GCALDaemon offers synchronization between Google Calendar and iCalendar compatible calendar applications. (Language: Java; license: APACHE version 2.0) (Gina Trapani offers some installation hints.)
I like Sunbird a lot (it is the Mozilla offering). Going under the name of Lightening is a calendar extension for Thunderbird that shares the Sunbird code base. For an interesting and "light" calendar, you can try Remind. (Linux Journal has a review.)
The address book situation is a scandal. Applications have not settled on a standard for data sharing and do not even adequately document their own formats. The best documented formats, VCARD and LDIF, are not great. For such a widespread need, this is a rather astonishing situation.
Thunderbird comes with a pretty good address book tool. Unfortunately, it saves address books in Mork (.mab) format, and if you back these up it cannot import them! Fortunately, there is a Mork parser library (Language: Python) Note that Thunderbird 3 should replace the horrible Mork format with MozStorage, thereby adopting the storage format now used in FireFox.
Most PIMs include address book functionality. Most email clients do as well. You can also get such (database) functionality in stand-alone applications. On Linux you can use Gaby or GTK-Agenda. There is also the Contacts application.
See Wikipedia for a comparison of project management software. Here is another comparison.
Here is one that is not yet listed there: ProjeLead (License: GPL) Probably Trac is best known in the open source community.
Open Financial Exchange (OFX) "is a unified specification for the electronic exchange of financial data". The format is an open standard. It is possible to convert CSV to OFX.
Advice on office suites: do not use them. Word processors slow down your writing: use a good text editor. Spreadsheets are a risky way to handle data [1 |2]: use a simple matrix programming language instead. The virtues of existing presentation packages do not outweigh their weaknesses, especially if you need to present mathematical formulae.
Now, since you are going to use them anyway, what should you use? Here are some basic considerations. Whom do you need to exchange files with? Do you use more than the basic functionality of word processors and spreadsheets? Do you want a multi-platform solution? Since everyone should choose a multi-platform solution and few people use more than the basic functionality of their office suites, I recommend OpenOffice, perhaps as part of the collection of applications on TheOpenCD. Of course most of the people you know will be using a commercial office suite, but you will be able to save your files in formats they can read, and as long as they are not using advanced features (e.g., templates, complex macros, or complex spreadsheet formulae) you will be able to open their files as well. Most users do not use such features.
Since office suites are often expensive, I will mention a few relatively cheap commercial alterntives.
Star Office
is essentially the commercial sibling to OpenOffice,
and it also supports the Open Document Format (as any good office suite should).
Corel WordPerfect Office
Soft.Maker is a cross-platform commercial suite.
602PC Suite is a MS compatible office suite.
Nowadays you can also consider online office suites.
The free ThinkFree is a popular option.
There are two primary reasons to provide people with documents: you want them simply to view them, or you want them also to modify them. Word processor formats are seldom a good choice in either case, although the versioning capabilities of modern word processors can be very useful in a collaborative setting. Plain text can often satisfy both needs. When more structure is needed, HTML will usually suffice. When formatting must be tightly controlled or access needs to be controlled, PDF is often a good choice. A relatively new, lighter-weight (and therefore web-suitable) substitute for PDF is DjVu (for which you will want to visit DjVu on sourceforge or Lizard Tech). Unipage allows storing complete web pages in a single file.
If you want even lighter weight than the very nice AbiWord, on Linux you can try Ted. Some Linux users like frames-oriented KWord.
Nowadays it is perfectly feasible to use a decent HTML editor as your word processor. The Amaya browser/authoring tool may be worth considering, although I have found it a bit slow and clunky. (Somewhat offsetting this is its native MathML support.) Another possibility is the web development suite offered free by Evrsoft.
If you are comfortable with markup, you can easily replace your word processor and get great added functionality. Try QuickScript. Another alternative: Tinydict.
It is now perfectly possible to rely on internet applications for word processing. I have had good experiences with Google Docs for basic word processing tasks and online collaboration. Zoho Writer looks even more capable, and has good math support as well. (Including the ability to produce math by inputting LaTeX.)
You will need to decide what format to keep your bibliography in, and what software to use to manage it.
Citation Management:
If you use a commercial word processor you will probably use the commercial EndNote
to manage your reference and format your citations.
However there are some interesting alternatives.
In particular,
LaTeX users have the traditional (and very powerful) BibTeX to manage the citations in their documents.
Even users of commercial word processors can take advantage of BibTeX by using Bibtex4Word.
New users should see the BibTeX user hints.
Now for the design of citation reference and citation style,
they have the even more powerful biblatex
(which greatly simplifies writing new styles).
(Users switching from natbib will want to know about the natbib-compatibility-mode,
which allows use of natbib's commands (e.g., \citep, \citet)
instead of the commands usually provided by biblatex (e.g., \parencite, \textcite).)
Python users can consider the bib4txt component of bibstuff,
which should particularly interest reStructuredText users who need bibliographic support.
(I recommend you get the most recent BibStuff.) (BibStuff License: MIT; Language: Python)
Chris Putnam's Bibutils
"interconverts between various bibliography formats using a common XML intermediate."
(Bibutils License: GPL; Language: C; binaries are available for many platforms.)
Users of Open Office or MS Word can insert references directly in their documents with Bibus.
CiteULike is an interesting "in the cloud" solution for managing references.
BibTeX is the traditional choice for citation management. (See the BibTeX user hints.) An interesting alternative is CrossTeX (License: GPL; dependencies: Python, PLY)
Traditional spreadsheets:
It has become very popular to use spreadsheets in education.
This has some downsides.
Traditional preadsheets are OK for very simple, one-off applications using small amounts of data.
For serious work,
they are too opaque, because they are too hard to document.
(If you have ever tried to figure out another person's complex spreadsheet, you know what I mean.)
Studies indicate that almost all large spreadsheet have serious errors.*
Basic data handling glitches have been documented even in the most popular spreadsheet applications.
The lack of transparent scripting facilities means that it is very difficult to understand someone else's spreadsheet or even one’s own spreadsheet developed months or years ago.
If all you want to educate someone to do is one-time, never-to-be-revisited, quick-and-dirty computations,
then teach them a traditional spreadsheet.
Otherwise teach them a format that allows serious documentation and transparency of manipulations.
At the very least,
eschew traditional spreadsheets in favor of newer alternatives,
such as scientific spreadsheets and engineering spreadsheets.
Comment: some problems with spreadsheets can in principle be overcome by using them directly just for data storage and then preforming manipulations via a scripting language that exploits the spreadsheet's computational and graphics facilities---on a Windows platform, perhaps VBA or better yet Python with win32com; on a Unix platform, perhaps ABV or Python or a plug-in that supports scripting. Of course this is not how most people use spreadsheets. There are also engineering spreadsheets that allow explicit scripting and treat data in a more object oriented fashion. These are tools that can be properly used for serious work.
Comment: Python can read and write tranditional spreadsheets. For simple spreadsheets see the CSV module. For more advanced need, consider xlrd and xlwt.
If you are interested in spreadsheet structures, you may be interested in Fenfire generally and ZigZag more specifically.
Perhaps the simple yet powerful NoSQL will meet your needs. More traditional approaches follow.
SQLite "is a small C library that implements a self-contained, embeddable, zero-configuration SQL database engine". (License: Public Domain.)
FireBird "is a relational database offering many ANSI SQL standard features that runs on Linux, Windows, and a variety of Unix platforms."
OpenOffice includes a database. GNOME Office includes GNOME-DB, which is reputed to be very good. For enterprise needs, PostgreSQL has a good reputation: PostgreSQL is a free-and-open-source, SQL-compliant, object-relational database management system, reputed to be highly-scalable. Using Ruby with Rails and say MySQL is getting a lot of buzz for developing data-base backed web applications.
Simple but structured needs may even be met by Open-RJ.
faces is a user friendly project management tool. (License: GPL; Language: Python)
Task Coach is a lightweight task manager. (License: GPL; Language: Python)
Task Juggler is very popular. (License: GPL)
OpenOffice includes a database. GNOME Office includes MrProject, "a project planning, scheduling and tracking tool.
Consider HDF5 for substantial databases. (Overview.) Binaries. Windows installation.
Scribus is a featureful, cross-platform desktop publishing application. Supports PDF 1.4 and Python scripting. "The Scribus file format is XML based; open and completely documented." (License: GPL) Used by professionals to send multipage full color layouts sent directly to commercial print houses. Supports CMYK separation, PDF generation, and much of the toolsets you get from commercial packages like Quark or InDesign.
HylaFAX offers an open source version for a variety of *nix platforms. (This OpenOffice setup discussion may be helpful.) I do not know of any FOSS fax software for Windows or Mac: let me know if you do!
Pidgin IM (formerly Gaim) is a free and open source instant messaging client for a variety of platforms. ScatterChat is a secure enhancement of gaim.
Mac users can consider Fire, which supports most popular instant messaging services. (GPL)
Calculators are still useful. Here are a few of many.
Reverse Polish Notation:
The dc desktop calculator,
for those comfortable in a shell (including cmd.exe),
is cross-platform, wonderfully fast, and ever handy---highly recommended!
Another cross platform possibility is kalc.
For Linux you can try rpncalc.
For Windows I like the freeware
RPNCalc,
which is also ported to WinCE.
RPN is an interesting calculator for the PalmOS.
And finally for PostScript enthusiasts,
I cannot refrain from mentioning PSCalc.
For a console calculator, try the cross-platform bc. (The bc manual is very good.) For a graphics calculator, try the cross-platform GraphCalc. Or just use gnuplot as a graphics calculator. GNU Emacs Calc has many features, including graphics using GNUPLOT. CoCalc is a freeware JAVA calculator.
Rascal is enough more than a calculator that it may be considered a simple matrix programming language. This is also true of cxc, and Iguana seems to be evolving in the same direction.
Check TheFreeCountry for a longer list.
Python users get a basic cross-platform solution automatically via the ftplib module. (For an even lighter approach, try this TFTP module.) The Python Cookbook uses this module to provide a threaded ftp client. As of August 2005, ftplib does not provide any secure services, however. For SSH2 services you can use paramiko, which relies on pycrypto. These are very easy installs! (See the paramiko README file for instructions. Windows users can also look at Voidspace for prebuilt PyCrypto binaries.) I provide an example (usable) SFTP client using these modules, but you can even have a graphical interface with SFTP support via wxSFTP. (If your needs are more substantial, you can use pycurl as a Python interface to libcurl, which should be able to meet all your ftp needs.)
If you need FTP/S, you can try TSLite, which offers a pure Python solution for FTP over TSL.
For Windows: I find the free and open source FileZilla to be excellent for FTP and SFTP.
(As of August 2005, however, I have had some problems with FTP/S in passive mode.)
Other possibilities:
WinSCP.
OpenSSH for Windows.
WS FTP
had a free (for academics and students), easy to use, ftp program for Windows platforms,
but I think the free version went away.
For Mac:
CyberDuck.
For Un*x:
NcFTP.
(Also runs on Windows and Mac, for those willing to learn ftp commands.)
OpenSSH.
GOCR, Kooka, OCRShop, ClaraOCR
Generating reports is a common need. These can be informal or presentational, and may or may not need to be printed.
gawk, a powerful report generation language which takes only a moment to learn well enough to produce simple reports. (E.g., you can manage student grades with Gawk much more easily than with a spreadsheet.)
ReportLab allows direct creation of PDF graphics and reports.
iText can be a very powerful report generator if you know a bit of Java.
Apache Formatting Objects Process (FOP) offers amazing flexibility. Java based. (License: Apache 2.0)
Program controlled printing can be a challenge, especially under Windows. If you have the option of producing your reports as PDF or as appropriately formatted text, then you can usually just ask your operating system to use a default application to print them. Otherwise, you will have to work harder.
Tim Golden offers a very useful discussion of Windows printing under Python.
GNU a2ps allows conversion of text (and other) files to PostScript, as does enscript and ASCIIprint.
wordaxe can be used for hyphenation. For example, you may want to generate your own PostScript or PDF. As a more specific example, the wordaxe hyphenation library offers ReportLab support. For an easy interface, try rst2pdf, which offers cascading stylesheets and supports TTF and Type1 font embedding.
There are many version control systems (VCSs): see the Wikipedia list. If you just need revision control for an individual project, you can use RCS. For simple version control on multiuser projects, consider Subversion (SVN). Currently distributed VCSs are the rage, with Bazaar (License: GPL), Mercurial (License: GPL), and Git (License: GPL) having particularly high profiles. This is probably not important for small projects. See the OpenSolaris evaluations.
See my SVN hints.
Subversion is probably the most widely used version control system for new projects.
There is an extensive user manual.
(Be sure to read about the basic work cycle.
Simplest bottom line: change to your working directory and enter
svn update, then make changes to your files.
Before you commit do another update,
and finally commit the changes with svn commit -m "My message about the changes.".)
The pysvn project provides a Python based graphical interface to SVN.
SVN on windows: download and execute the Windows installer. Users who dislike the command line should consider TortoiseSVN as a user-friendly Subversion client.
SVN with Vim: vcscommand provide keybindings for SVN control from the Vim editor.
Free and low cost SVN repositories:
OpenSVN
Google Projects
(open source projects only)
Unfuddle
(this one looks promising for general use)
assembla
nexUmoja
Free and low cost Mercurial repositories:
freeHg.org
Track stolen laptops and cell phones with Prey.
Calibre has quite amazing conversion capabilities and supports many e-book formats.
Outlines can help writers and programmers.[ 1, 2 ] Many good editors offer substantial outlining capability. Examples include the VimOutliner and the emacs outline mode.
There are many commercial and free outliners. The Java Outline Editor offers serious outline functionality.
FreeMind is a highly capable cross-platform mind mapper. It is Java and includes and Windows installer. (License: GPL) For a more document oriented approach, try Kdissert. (License: GPL)
Miro (License: GPL. Formerly known as Democracy Player).
The basic situation. The graphics problem.
The hoary standard is m4. An interesting alternative is empy. Good luck.
Until recently you were likely to get a crash-prone operating system when you bought a computer, but finally even the most widely distributed operating systems are getting better. However upgrades are still expensive. You may want to consider some excellent alternatives. I will first mention an offbeat one: YouOS is a "web operating system", meaning you access it anytime you have web access.
After the Windows and Mac operating systems, most people will think first of GNU Linux, an excellent, free, Open Source version of the Unix operating system. Another popular free and open source Unix relative is FreeBSD. Another popular version of the Unix operating system is Solaris, which is available as OpenSolaris.
Plan 9 is roughly a faster, more secure multi-processor Unix. There is now an open source implementation of BeOS. (Can install and run within Windows.) There are also free applications, of course.) QNX's Neutrino Real Time Operating System is also a compact and stable operating systems. (Can install and run within Windows, and thus does not require a separate partition or boot loader!) An interesting effort to produce an open source substitute for Windows NT is ReactOS, which already has basic console functionality. A few people may also be interested in FreeDOS. And for those seeking the bleeding edge, there is Unununium (but I have had trouble with the link lately).
Where to get a decent shell for Windows? Try GNU Bash for Windows. (Here is an introduction to bash programming.) For free and open source, you might try win-bash. If you run WinXP SP2, you can also try Windows Power Shell (requires the .NET framework v.2).
Fink has an extensive collection of Unix tools for Mac users.
Note that password protecting your Word files does not encrypt them. Password protection of PDF files is easily cracked, although Adobe requires that readers respect the protection. Some editors (e.g., Vim) allow easy, strong encryption of your text files.
Probably the best platform for introductory exploration of agent-based models is NetLogo, which includes an extensive Models Library. While NetLogo's statistical and mathematical support is limited, you can link it to R or link it to Mathematica.
Java Agent-based Simulation (JAS) library
Swarm is useful for multi-agent simulation projects.
Evolving Objects is "is a templates-based, ANSI-C++ compliant evolutionary computation library". (License: LGPL)
Banshee music player. (License: MIT)
CDex CD ripper. (License: GPL) On Windows, CDex may provide an alternative to the poor iTunes error correction (i.e., the presence of pops and clicks).
Tomboy note-taking application.
Possibly the simplest open standard for fixed periodicity time-series data is the open-databank standard. Most time series econometrics packages support some version of this.
AstroAsciiData provides simple database functionality for ASCII tables.
HDF5 "is a general purpose library and file format for storing scientific data". Some support can be found in the econometrics community, both in commercial and free packages. Python users have excellent support via PyTables. (To use PyTables with Python 2.4 in Windows platforms, you will need to get the HDF5 library compiled for MSVC 7.1 (aka .NET 2003). Users of Python 2.3 on Windows will have to download the version of HDF5 compiled with MSVC 6.0.) Octave and R provide HDF5 support. Commercial applications supporting HDF5 include Mathematica and MATLAB version 6.5+, among many others.
The netCDF libraries "support a machine-independent format for representing scientific data". The netCDF distribution includes interfaces for C, Fortran77, Fortran90, and C++, and interfaces are reportedly available for Ada, IDL, Java, MATLAB, perl, Python, R, Ruby, Tcl/Tk. The interface provided by ScientificPython is supposed to be excellent. PyNIO adds to this support of additional formats. Another possibly faster way to read the netCDF format is pupynere, a pure Python solution. (License: MIT)
Be sure to set your client to produce plain text email. I have written up a few reason and clues.
Make Vim your editor and call it as
c:\programs\vim\vim73\gvim.exe -c "so $VIM\vimfiles\mail.vim" %s
where mail.vim is where you put any mail processing commands
(e.g., set ft=mail tw=75).
You are welcome to use my mail commands.
Under OS X Mahogany uses the Unix OpenSSL library, so you need to: 1. install openssl libraries (you can get them from fink) 2. point M to then: in the "helpers" page of the options dialog, add the correct paths to them, then it should work
\pathto\gvim --nofork -c "setf mail",
so you will get 'mail' syntax highlighting and ftplugins loaded.
Or if you have defined say mail.vim,
a file of useful macro,
you can instead use e.g.,
\pathto\gvim.exe -c "so $VIM\vimfiles\mail.vim".
After installing the extension,
edit the composition toolbar (the one for replying to email, not the main application toolbar)
and add a button for the external editor.
You can then click that button and your current email reply will be opened in Vim.
%VIM%\vimfiles folder,
and change your External Editor command to, e.g.,
C:\programs\vim\vim73\gvim.exe -c "so $VIM\vimfiles\ai_mail.vim".
d key with goDoCommand('cmd_delete');
and the x key with goDoCommand('cmd_MsgCompactFolder');.
If you prefer to POP your mail, you can get more control over this than Pine offers with radiks, a tiny mail transfer program (MTA) for win32 (Windows 9x/NT/2000) which reads mail from a pop3 server and transfers it (filtered, if you want) to your local hard drive.
Use the Lapack routines if you need speed. E.g., for a QR decomposition use scipy.linalg.flapack.dgeqrf instead of scipy.linalg.qr.
def dot(a, b):
return numarray.dot(a, b.view())
The original b is then not touched, and the screwed-up matrix is
discarded.
import sys
sys.path.remove('')
import sets
to remove the current directory from Python's search path.
If you then need access to any modules in the current directory,
use sys.path.insert(0,'')" first.
As late as 2004,
the Numeric and numarray documentation incorrectly stated that
and, or, and not would
operate element-by-element on arrays.
Lists are sorted in place, so mylist.sort() return None,
but mylist is now sorted.
Rossiter wrote an accesible Introduction to the R Project.
Documentation:
Windows users may want to read R Guide for Windows Users by Kevin Wang.
Lund University offers some supplementary documentation;
also Harrell's R utilities along with his guide to LaTeX tables and S may be useful.
Ikaha offers some introductory discussion of generating graphics in R.
Be careful with the definition of R’s PRNG for the geometric distribution:
rgeom has support on nonnegative integers,
since R has p(x) = p (1-p)^x.
A perhaps more common parameterization is p(x) = p (1-p)^(x-1):
which you can match by adding 1 to the values returned by rgeom.
You can write LaTeX documents containing R code whose ouput is to be included in the document with Sweave.
>>> from win32com.client import Dispatch
>>> sc=Dispatch("StatConnectorSrv.StatConnector")
>>> sc.Init("R")
>>> print(sc.Evaluate("2+3"))
5.0
>>>
Occasionally you will need to provide or adjust the bounding box information for a graphic. Here are some resources.
abiword --to=latex test.abw
pdflatex test.latex
<Scheme
name="AbiVi"
KeyBindings="viEdit"
KeyBindingsCycle="1"
/>
<Select
scheme="AbiVi"
autosaveprefs="1"
useenvlocale="1"
/>
print /flush;;
to force GAUSS to flush the buffer.
You can also use the "configure/preferences/cmd_window" menu
and uncheck the box for "Buffer output".
Please note that files can only be downloaded via COMMAND LINE FTP, not
a browser (such as Internet Explorer, Netscape, Firefox, etc.). You
must use a command window to download the files. To open a command
prompt window, click on Start, then Run, and type cmd.
GAUSS Light 8.0 for Windows
---------------------------
Below is a list of files that you may wish to download and
what each is:
GAUSS_Light_8.0_Win.zip [GAUSS Light 8.0 software]
GAUSS_8.0_Manual.zip [all documentation zipped together]
Save the files that you download to either your root directory
(usually C:) or a directory that you set up that has no spaces
in the title; there can be problems saving the files to a
directory such as C:\Documents and Settings\<username>.
You *must* know the name of the files you wish to download.
DO NOT USE A BROWSER TO DOWNLOAD THE FILES. To download
the necessary files via command line ftp, do the following
at a terminal prompt:
1. Type the following at the ftp prompt:
ftp ftp.aptech.com
2. Once you are in the ftp.aptech.com site, type:
anonymous
then when prompted enter your email address as the password.
3. Type the following at the ftp prompt to get the files
(ftp> represents the ftp prompt you should see, do not type that):
ftp> get
(remote-file) /outgoing/GAUSS_Light_8.0_Win.zip
(local-file) GAUSS_Light_8.0_Win.zip
ftp> get
(remote-file) /outgoing/GAUSS_8.0_Manual.zip
(local-file) GAUSS_8.0_Manual.zip
ftp> bye
Approximate file sizes
----------------------
8.8 MB GAUSS_Light_8.0_Win_32.zip
8.5 MB GAUSS_8.0_Manual.zip
========================================================================
========================================================================
Please note that files can only be downloaded via COMMAND LINE FTP, not
a browser (such as Internet Explorer, Netscape, Firefox, etc.). You
must use a command window to download the files. To open a command
prompt window, click on Start, then Run, and type cmd.
GAUSS Light 8.0 for Mac Universal
---------------------------------
Below is a list of files that you may wish to download and
what each is:
GAUSS_Light_8.0_Mac_OS_Xu.dmg [GAUSS Light 8.0 software]
GAUSS_8.0_Manual.zip [all documentation zipped together]
Save the files that you download to either your root directory
(usually C:) or a directory that you set up that has no spaces
in the title; there can be problems saving the files to a
directory such as C:\Documents and Settings\<username>.
You *must* know the name of the files you wish to download.
DO NOT USE A BROWSER TO DOWNLOAD THE FILES. To download
the necessary files via command line ftp, do the following
at a terminal prompt:
1. Type the following at the ftp prompt:
ftp ftp.aptech.com
2. Once you are in the ftp.aptech.com site, type:
anonymous
then when prompted enter your email address as the password.
3. Type the following at the ftp prompt to get the files
(ftp> represents the ftp prompt you should see, do not type that):
ftp> get
(remote-file) /outgoing/GAUSS_Light_8.0_Mac_OS_Xu.dmg
(local-file) GAUSS_Light_8.0_Mac_OS_Xu.dmg
ftp> get
(remote-file) /outgoing/GAUSS_8.0_Manual.zip
(local-file) GAUSS_8.0_Manual.zip
ftp> bye
Approximate file sizes
----------------------
13.9 MB GAUSS_Light_8.0_Mac_OS_Xu.dmg
8.5 MB GAUSS_8.0_Manual.zip
proc quantilenew(x,e,a,b,c,d);
local w, wt, f, r, i, z;
if minc(e) < 0 or maxc(e) > 1;
errorlog "Inadmissable quantile levels";
if not trapchk(1);
end;
else;
retp(error(0));
endif;
endif;
w = a + (rows(x) + b) * e;
wt = floor(w);
f = c + d*(w - wt);
if wt == 0 or wt == rows(x);
errorlog ftos((maxc(1/minc(e)|1/(1-maxc(e)))),"*.*lf",1,0)
$+ " rows required for this level";
if not trapchk(1);
end;
else;
retp(error(0));
endif;
endif;
r = zeros(rows(e),cols(x));
i = 1;
do until i > cols(x);
z = sortc(x[.,i],1);
r[.,i] = z[wt] + f .* (z[wt+1] - z[wt]);
i = i + 1;
endo;
retp(r);
endp;
** =========================================================================== ** Procedure Format Purpose Line ** =========================================================================== ** inthp1 y = inthp1(&f,pds,ctl); integration over -inf,+inf ** inthp2 y = inthp2(&f,pds,ctl,a); integration over a, +inf non-oscil ** inthp3 y = inthp3(&f,pds,ctl,a); integration over a, +inf oscill ** inthp4 y = inthp3(&f,pds,ctl,c); integration over a, b ** ===========================================================================
atranspose,
so that the two dimensions that you want in your matrix are in the two last dimensions of the array.
Then extract the matrix with getmatrix using the appropriate locator.
trap and scalerr commands.
(See the example for 'scalerr' in the GAUSS Command Reference.)
complex(b,0)^x,
where b<0 is the base and x is the exponent.
let string a[4,4]="";.
But what if the dimensions r, c are not known ahead of time?
Then use a=""$+zeros(r,c); instead.
call setvwrmode("many");
call setvwrmode("one");
_pcolor.
If you do not like the default colors
for the graph characteristics (ticks, frame, labels, background, etc)
you can change them:
see the help for _pmcolor.
_pcmdlin = "-c=1 -cf=c:\\filename.eps";
_ptek global,
and then use the tkf2eps function to convert the .tkf files to Encapsulated Postscript.
The syntax is: ret = tkf2ps("mytekfile.tkf", "myepsfile.eps");
(see the GAUSS Command Reference).
i = sqrt(-1);x=2-3*i;.
Note that GAUSS does not set the value of i by default;
and you can pick any variable you want for this purpose.
for command in GAUSS the loop indicator is not a floating point.
Up to v.3.2.44, you need a hack if you want to pass the loop indicator to a procedure
(e.g., to convert it to a character value). For example, the following code works.
for i (1,10,1);
j= i;
print $ftocv(i+0,8,0) $ftocv(j,8,0);
endfor;
if abs(imag(x)) ≤ 1e-12 ;
x = real(x);
endif;
For real symmetric matrices,
be sure to compute eigenvalues with eigh instead of eig:
this guarantees real eigenvalues and is much faster than eig.
Furthermore, if you use eig() for a real symmetric matrix,
rounding error in the calculations will nearly always produce complex
eigenvalues with imaginary parts that are very small.
cdfchii(0.9998,13);
As one might expect, the same problem arises for the inverse gamma function.
Test with the code snippet 2*gammaii(13/2,0.9998);
let x1 = 4;
let x2 = a;
s1 = "" $+ x1;
s2 = "" $+ x2;
if (s1 $== x1); "ok"; endif;
if (s2 $== x2); "ok"; endif;
Only the second equivalence (s2 $== x2) is true.
#define A print "---"; #ifdef A /*space ^ */ /*here | */ print "A"; #endif print "===";yields
--- ===as its output.
for i(1,5,1);
varput(eye(i),"x"$+ftocv(i,1,0));
endfor;
c:\gauss\tgauss.exe -b c:\mypath\myfile.gau
where you need to adjust the paths appropriately.
The -b flag is used to call GAUSS in batch mode.
Save the batch file (e.g., as filename.bat).
As with any batch file, you can double click it to run it
or run it from the command line.
sa = ftostrC(x,"%8.4lf");
fp = fopen("matrix.asc","w");
call fputst(fp,sa);
fp = close(fp);
c:\programs\aspell\bin\aspell check c:\temp.tex
(assuming that's where you put it, of course).
You may want to change your path so that aspell is in it.
map <f7> <esc>:w<cr>:!aspell check %<cr>:e! %<cr>
map <Leader>s <esc>:w<cr>:!aspell --dont-backup -c %<cr>:e! %<cr><cr> c:\Python27\python.exe -c "import scipy;scipy.test()" >c:\file.txt 2>&1
mygraph.writeEPSfile("c:/mydir/myfig.eps",paperformat=pyx.document.paperformat.Letter)
bboxenlarge=False to ensure a "tight" bounding box.
For 2-D data plots, Titus Winters has written a nice PyX tutorial.
Be sure to see the examples and gallery on the PyX website. I provide a heavily commented elaboration of the shaded integral example.
For a simplified interface to PyX, you can add PyXgraph or, if you would like an interactive command line interface, PyXPlot. For geometry, geoPyX is limited but useful.)
D "mgs.exe -q -sPAPERSIZE=a0 -sDEVICE=pdfwrite -dCompatibilityLevel=1.2 -dUseFlateCompression=true -dNOPAUSE -sOutputFile=\"%o\" \"%i\" -c quit"Some applications (e.g., PyX) produce negative bounding boxes. (See Pyx hints for a PyX solution.) While perfectly legal, this creates a problem for dvipdfm. During conversion to PDF, the EPS files are clipped at the papersize boundary rather than the figure boundary. I don't know how to force pdfwrite to behave nicely, and epstopdf does not work because it intentionally alters the bounding box for the PDF file. You can try it though by changing the MiKTeX configuration to:
D "epstopdf --outfile=\"%o\" \"%i\" "
\begin{figure}[ht]
\special{pdf:image (mydir/myfile.pdf)}
\end{figure}
To LaTeX (the disk copy of!) your current document, select your TeX from the "Tools" pull-down menu.
IMPORTANT: When you LaTeX a document in TextPad, a Command Results document is opened.
When LaTeX finishes executing, it displays the message:
Process completed with exit code 1.
YOU MUST CLOSE THIS WINDOW AFTER EVERY RUN.
Failure to do this will cause subsequent LaTeX or BibTeX runs to hang.
To avoid the afore mentioned problem, I recommend running MikTeX as a DOS command, which can also be done as a TextPad tool.
If you decide on this option, go to the TextPad menus Configure, Preferences, Tools.
Click on add and select DOS Command.
A window will appear in which you type the full path to the
command you wish to execute. For example, for MiKTeX type:
c:\texmf\miktex\bin\texify.exe $BaseName
(If you use the default MiKTeX installation, you do not need a fully qualified path name.)
Click OK, then Apply,
then go to the tool you just added
(it should be listed under Tools when you expand it)
and make sure to UNcheck the "capture output" box.
If you do all of this, then when you select the tool, a DOS window will pop open and show you the execution results. This is useful for when you have compilation errors,
you can hit enter, "X" or whatever,
whereas the other way you can't.
Older versions of TextPad have a small bug:
the DOS window closes upon the end of execution of your tool, whether the close window box is clicked or not.
Note that the texify command offered in MikTeX automatically runs BibTex for you.
To LaTeX your current document, select Bibtex32 from the "Tools" pull-down menu.
IMPORTANT: When you LaTeX a document in TextPad, a Command Results document is opened.
When LaTeX finishes executing, it displays the message:
Process completed with exit code 1.
YOU MUST CLOSE THIS WINDOW AFTER EVERY RUN.
Failure to do this will cause subsequent LaTeX or BibTeX runs to hang.
To view your LaTeXed document, select your viewer from the Tools pull-down menu.
To view your LaTeXed document, select your viewer from the Tools pull-down menu.
Reassign Ctrl-e to WordRightEnd as follows: choose Customize from the Configure menu, select the Keyboard tab, choose Cursor from the Categories list, choose WordRightEnd from the Commands list, type Ctrl+e in the Press New Shortcut box, click Assign, and click OK. You will then want to assign Ctrl+Shift+E to WordRightEndExtend.
On campus: To fix font problems on the display, make sure the Windows Multilingual Support is installed. If that is not an option, go to Tools, User Setup, Font Mapping and check the Use Symbol Font mapping box.
Be sure to learn the keyboard short-cuts: see especially the help for Key Prefixes. For example, you can logical negation as ctrl-s,N and the partial derivative sign (∂) as ctrl-s,d. (See the Help search.) Also, I strongly recommend changing the default settings under Tools, UserSetup, Math: set it so that two spaces switches to math and a space at the end of math switches to text.
Be sure to visit Yngve Svendsen's Scientific WorkPlace Unofficial Homepage (although I have had some connection difficulties).
Graphics: When using the JPGs or TIFFs, edit the file tcispech.ini and change the setting for MaxGraphicsMemoryUsage. Try doubling or tripling the default setting of 4000. When using EPS graphics, save your document using the Portable LaTeX filter and change the options for the graphicx package to use dvips. The graphics will only appear when printing, but they should appear.
To use Scientific Word on the EagleNet, you will first need to install some (non-executable) files on your computer (which ought to have say 30Meg free disk space and 8Meg RAM); do this by entering "enetupgr sword" (without the quotes) at the DOS prompt. (Note: be sure to keep your macros in a separate file, which you \input in your preamble.) Be sure to see the Scientific Workplace Unofficial Homepage, which include instructions on how to use MiKTeX with SWP.
You can get all the functionality of Scientific Word
except for the typesetting and associated TeX functions in
Scientific Notebook for Windows 9x and NT.
Many useful functions are in the
free Demo version, although this version cannot print, save, or copy from read/write documents.
While you are on the AU campus, you are in luck:
Scientific Notebook is available as an EagleNet Application.
Users must first open EagleNet Applications.
(If you don't have EagleNet on your Start menu,
just pick Start, Run and the type `nal' in the dialog box.)
You should see a Math/Statistics/Research
folder on the left, in which you will find the
Scientific Notebook icon.
Double click the icon to run the program.
The first time you run the program, several system files
will be copied down to your hard drive before the program opens.
Each time after that initial setup the program will run
as soon as the icon is double-clicked.
The program is accessible to the major academic user groups
and all student users.
Since it is a 5-user license, you may occasionally find you have to wait until someone logs off to use Scientific Notebook. I do not expect this to happen, but if it happens to you let me know and I will apply for more copies.
Subversion is easy and excellent. Here is a ten minute tutorial. Windows users who prefer to avoid the command line can just use TortoiseSVN.
How to resolve Subversion Conflicts
svn add --non-recursive mydir.
One disappointing thing: it would be nice to add a directory
and all its files except those matching the svn:ignore property.
Subversion does not currently support this.
Here is one work around.
You can set an editor (e.g., for commit messages and property editing)
in the Subversion config file.
On Windows you should be able (after installing Subversion) to find it here:
\Users\YourUserName\AppData\Roaming\Subversion.
Search for editor-cmd and follow the instructions.
(I am currently using editor-cmd = C:/programs/Vim/vim73/gvim.exe -f.
If you use a path with spaces in it, you will have to quote it.)
Once you ensure that Subversion has access to a text editor,
you can edit the list of patterns it will ignore in any directory.
E.g., svn propedit svn:ignore . (note the final period)
will edit the patterns for the current directory.
\usepackage[T1]{fontenc} .
Unfortunately, on its own, this will probably lead to the
use of bitmap fonts and thus "fuzzy" screen output.
According to Guenter Milde,
there are several reasons for this choice.
\usepackage{lmodern})
or by using a Docutils command line argument
(--stylesheet=lmodern).
Another popular solution is the "Times/Helvetica/Courier" combination,
which you can get by adding the following to your style sheet:
\usepackage{mathptmx} % Times for serif and math
\usepackage[scaled=.90]{helvet} % downscaled Helvetica for sans serif
\usepackage{courier} % Courier for teletype (mono-space)
or with the following Docutils command line options:
--documentoptions="scaled=.90" --stylesheet="mathptmx,helvet,courier".
--font-encoding=OT1
(or even --font-encoding="").
Required tab
and the issue number is entered on the Optional tab.
General tab.
Before installing Matplotlib, make sure you have installed NumPy.
To get the most from Matplotlib,
you need to clearly understand the difference
between a figure instance and an axes instance.
A figure instance holds a drawing.
Just like a figure in a journal article.
When you call `subplot` it creates an axes instance
on the **current** figure. If you call `subplot` again
in a way that overlaps your previous subplot,
this **replaces** your previous axes in the current figure.
Instead, make sure you create a new figure instance
in which to create your new drawing.
import matplotlib.pyplot as plt fig1 = plt.figure() ax1 = fig1.add_subplot(1,1,1) #now draw on ax1 fig2 = plt.figure() ax2 = fig2.add_subplot(1,1,1) #now draw on ax2
Here is a simple example for creating a figure
and displaying it onscreen.
It assumes that you have version 0.92.1 or newer.
(Otherwise use pylab instead of pyplot.)
Note the hierarchical approach:
the pyplot interface creates the figure object,
the figure object creates the axes objects,
and the axes objects create the other objects
(including, implicitly, the axis objects).
# preliminaries
import matplotlib
matplotlib.use('TkAgg') #note choice of GUI backend!
import matplotlib.pyplot as plt
# create a new figure
fig = plt.figure(1)
ax = fig.gca() #get current axes, making one if nec
ax.plot([1,2,3],'r-')
ax.set_title('Easy Line Plot')
# display your figure onscreen
plt.show()
Here is a simple example for creating a figure
and saving it, without displaying it onscreen.
(I.e., no GUI.)
It assumes that you have version 0.92.1 or newer.
(Otherwise use pylab instead of pyplot.)
# preliminaries
import numpy
import matplotlib
matplotlib.use('Agg') #note choice of backend: no GUI!
from matplotlib import pyplot
#create some artificial data for this example
x, y = numpy.random.rand(2,50) #the data (50 points)
# create a new figure
fig = pyplot.figure()
ax = fig.add_subplot(111)
ax.plot(x, y, marker='.', linestyle='', markerfacecolor='blue')
ax.set_title('Scatter dots')
ax.set_xlabel('x')
ax.set_ylabel('y')
# save figure to file
fig.savefig('/temp/myfig.png', dpi=96)
from matplotlib.backends.backend_svg import FigureCanvasSVG
from matplotlib.figure import Figure
fig = Figure()
ax = fig.add_subplot(211)
ax.plot([1,2,3])
ax.set_xlabel('time')
canvas = FigureCanvasSVG(fig)
canvas.print_figure('myfile.svg')
Matplotlib's pyplot facilities are convenience facilities for the user with modest needs. For some examples (e.g., embedding Matplotlib in other applications) it is important not to use these facilities. In this case, you will need to handle figure and canvas creation yourself. For example, here is our first example redone to be more fully object oriented.
# preliminaries
from matplotlib.backends.backend_agg import FigureCanvasAgg as FigureCanvas
from matplotlib.figure import Figure
# create a new figure
fig = Figure()
ax = fig.add_subplot(111)
ax.plot([1,2,3],'r-')
ax.set_title('Easy OO Line Plot')
ax.set_xlabel('x')
ax.set_ylabel('y')
canvas = FigureCanvas(fig)
canvas.print_figure('temp.eps')
All Matplotlib plotting functions trigger autoscaling.
This affect, e.g., setting the axes limits.
To prevent your limits from being overridden,
call xlim/ylim after any plotting functions.
Alternatively, you can turn autoscaling off:
gca().set_autoscale_on(False)
Figure.subplots_adjust,
like this:
figure() subplots_adjust(hspace=0.4) # default: 0.2 subplot(211) subplot(212)
Fans of Edward Tufte may wish to look at etframes.
Note that if you set_aspect on a axes instance you will still need to apply_aspect as well (or call draw).
Matplotlib is capable of fully object oriented graphics programming. There is a very useful tutorial. If you want to embed Matplotlib in a GUI, you must use the object oriented API and not pyplot. The Matplotlib website includes examples of embedding. (For example, embedding_in_qt.py.)
wxmpl is supposed to be the best way to integrate Matplotlib into wx.
import matplotlib
matplotlib.use('GTKAgg')
from matplotlib.pyplot import *
# GTK backend
from pylab import *
import gtk
figure(1)
plot([1,2,3])
manager = get_current_fig_manager()
# see gtk.Window class docs at
# http://www.pygtk.org/pygtk2reference/class-gtkwindow.html
manager.window.set_position(gtk.WIN_POS_CENTER)
figure(2)
plot([1,2,3])
manager = get_current_fig_manager()
# see gtk.Window class docs at
# http://www.pygtk.org/pygtk2reference/class-gtkwindow.html
manager.window.set_position(gtk.WIN_POS_NONE)
show()
Another user offered a WX example:
# WX* backend (manager.window is a wxFrame)
# http://www.lpthe.jussieu.fr/~zeitlin/wxWindows/docs/wxwin_wxframe.html#wxframe
figure(1)
plot([1,2,3])
manager = get_current_fig_manager()
manager.window.SetPosition((100,100))
#or: manager.window.Centre()
show()
Todd Miller offered a TkAgg example:
# set the window position to X=200, Y=300
get_current_fig_manager().window.wm_geometry("+200+300")
set xzeroaxis and set yzeroaxis,
use axhline() and axyline().
Prior to version 0.63,
Matplotlib does not have an equivalent of gnuplot's set xzeroaxis.
(This draws a horizontal line across the xrange at y=0.)
John Hunter explains how to achieve the same effect,
and it provides many insights into matplotlib.
"What you want to do is plot a line where the y coord is in data units and equal
to zero, and the x coord is in axes units and spans the xrange. The
line stretches from left to right regardless of the xlimits.
Each axes provides a data transform and an axes transform, so that you
can specify lines/text/etc in either coord system; axes coords are 0,0
for lower left and 1,1 for upper right. But what you want to do is
mix the data and axes transforms for x and y. The transforms module
provides a helper function for this. The following code is freestyle
(untested) but should work:
from matplotlib.transforms import blend_xy_sep_transform
ax = gca()
trans = blend_xy_sep_transform( ax.transAxes, ax.transData)
plot([0,1], [0,0], transform=trans)
pyplot.plot(d, f(d), color = (1,0,0)).
ax = pyplot.gca()
ax.get_xaxis().set_ticks_postion('bottom')
ax.get_yaxis().set_ticks_postion('left')
Kawa offers a very useful collection of supplemental programs and data in EViews format, including the NBER historical series and the PENN World Tables.
EViews 5 can read and write many data formats.
Up to version 4,
the save command is not correctly documented in the EViews documentation.
If you provide a filename as an argument, it is really equivalent to File.SaveAs.
That is, it saves under the new name and changes the name of the current workfile.
In fact, as of version 4, this is the only way to change the name of a workfile in RAM.
In Eviews3, you could use scat(r) to get in a single graph
multiple scatter plots with their regression lines. This is not possible in
EViews4, where the replacement linefit command only uses the first
two members of its group argument.
missing observations: @obs(x[,s]) gives you the number of non-missing observations in x in the current sample or in sample "s" if the option is listed. One can access the number of non-missing observations for a group with @comobs.
%param1, equal to a complicated function of parameters, which recurs in a system estimation.
As a simple example:
%param1 = "c(1) + c(2)"
system1.add y = c(1)* x1 + x2/({%param1})
Oddly, string substitution only works for procs (commands) and not for assignments (using = ).
For example,
scalar trythis = ({%param1})
doesn't work.
(In this case, EViews will look for an object named c(1)+c(2) without evaluating the expression.)
Backwards compatibility: Eviews 3 and EViews 4 are not fully compatible. See the version 4 User's Guide page 532: "A Note on EViews Backward Compatibility" and page 580/581: "Converting from Version 3 Sspace" for some changes from version 3 to version 4. Briefly:
AU Econ students and Faculty:
You can access EViews on any networked campus computer.
Look in the Math/Stat/Research folder in the EagleNet Applications/NAL window.
Double click the EViews icon.
This should install a short-cut on your machine.
Note that this is a limited user license,
so you may be refused access to EViews during high usage times.
Since it is a 5-user license, you may occasionally find you have to wait until someone logs off to use EViews.
I do not expect this to happen, but if it happens to you let me know and I will apply for more copies.
Vim is free software. First get information about which files to download, then download it. Finally, if you are new to Vim, get some documentation. Be sure to do the Vim tutorial and to read the help for "navigation". If you want additional documentation, consider Vi Improved—Vim by Steve Oualline or Vim ge-packt by Reinhard Wobst.
Windows installation:
To install Vim on Windows, get the self-installing Windows executable.
Double click it and install where desired.
Installation creats a 'vim' directory.
Below that is a 'vimfiles' directory.
I recommend that Windows users who are new to Vim
i. copy my ai_vimrc.vim attached file to their vimfiles directory,
and then
ii.
look for the '_vimrc' file in the 'vim' directory
and add at the bottom of that _vimrc file
the following command:
source $VIM/vimfiles/ai_vimrc
Getting started:
Look for a file called vimtutor
or vimtutor.bat.
Set aside 20 minutes for the tutorial,
and then run the tutorial
(e.g., by clicking the file icon).
The Vim cursor stays in the viewing window,
in contrast with some Windows applications.
If you want to cursor down and then return to where you started,
set a mark before moving. (See :h marks.)
But, if you want to be able to page down and then page back up to where you started,
use ctrl-d and ctrl-u rather than Pg-Dn and Pg-Up.
:help :python, :help python-examples,
and especially :help python-vim.
Start with
:python import vim :py cb = vim.current.bufferNote that cb is now an iterable container of strings. You can assign to the i-th line by assigning to cb[i].
rename engspchk-v42.tar.gz.php engspchk.tar.gz
gunzip engspchk.tar.gz
tar -oxvf engspchk.tar
delete engspchk.tar
let g:cvimsyn = "c:/programs/vim/vimfiles/CVIMSYN"
:helptags c:\programs\vim\vimfiles\doc
:h engspchk
let g:spchkmouse=1
let g:spchkmouse=0
AU students and faculty:
You can access Vim on any on any PC with the Novell client configured for AU's network
(student machines often have only TCPIP -internet- connections).
The VIM editor has been installed on the AUAPPS server (your J: drive).
(GUI versions 5.7, which is smaller, and 6.0, which has more functionality.)
The version 6 installer application can be found in the Math-Stats-research folder of
the Eaglenet Applications/NAL window. It is labeled Vim 6.0 Install.
When you first launch the program,
there will be a very short registration of the program to ensure OLE functionality.
Launching the program is simply a matter of clicking on the shortcut in the Start - Programs - Vim 6.0 folder.
If you wish to run the program, use any text editor (e.g., NotePad) to add the following line to the autoexec.bat file on the local hard drive of your PC (you will only do this once):
set HOME=G:\
Save the file and restart the PC.
The program can now be launched from NAL/EagleNet Applications under the
Math/Statistics/Research folder.
Clicking the icon will copy the _vimrc file to your G: drive (i.e., your Network drive) and install a short-cut on your computer.
The icon in the Math/Stat folder of EagleNet Applications
will copy a shortcut to a new (Start -- Programs -- Vim) directory.
(You can always move this shortcut to your desktop).
Once installed to your desktop,
you can launch the program without opening the EagleNet Applications window.
(To ensure that the VIM installer runs from EagleNet Applications:
right-click on the icon (now called "Install VIM") and choose Verify
from the pop-up menu. This forces the Novell Application launcher to copy
the shortcut to your PC.)
Once you get used to using a mode-based editor, you will fall in love with it. (There is a very nice manual, helpful reference material, and a nice Vim regular expression tutorial.) The only downside is that you'll have to get your grep (or agrep or the even more powerful MiniTrue) and spellcheck separately. (There is a Vim based spell checker for Vim: Dr. C's engspchk.vim.) You can adapt the Moby thesaurus for use with Vim.
There is a recent book devoted to learning Vim: Vi IMproved by Steve Oualline, also called the VIM book. You can view the Vim book online.
Be sure to use Jeff Lanzarotta's bufexplorer.vim. (One warning: as of early 2001, the buffer delete command in bufexplorer uses bd!, so changed buffers will be deleted upon request without a warning. Change this to bd)
Ctags is no longer included with Vim (it has grown into a project of its own.)
A useful plugin is Universal Text Linking, which executes URLs in plain text (e.g. call webbrowser, link MS Word documents, text files, embed vim commands).
Vim digraphs are based on RFC 1345.
You may find it useful to begin your writing with an outliner.
For user questions you can turn to the Vim mailing list. There is an archive.
Note that for all systems the Vim distribution is split into an archive with runtime files (documentation, syntax files, etc.) and a binary and/or source archive. You should download at least two archives!
You can find many useful hints at Softpanorama Western Orthodox Editors Page.
To get a word count in your file: g ctrl-g. To change line spacing see the help for linespace. To change the font in gvim, you can use the menu dialog Edit/SelectFont, or you can include your selection in your _gvimrc file. (I use set guifont=andale_mono:h9,courier_new:h10.) Do not forget that editors should only use monospace fonts.
If you type very slowly, you need to slow down Vim's macro recognition. See the help for map-typing. I recommend resetting timeoutlen according to the example in the help for timeoutlen.
'. takes you to your last edit
If you want to fill an entire page with background color,
you do not need to know the dimension of the page.
Just start your PostScript program by setting the color
and then giving the command clippath fill.
(Of course few printers can print to the exact edge of the page.)
Transparency: PostScript uses an opaque imaging model. It does not support transparency. However, there is a workaround available if you have Adobe Distiller. You can add a "PDFMark" to your Postscript file to set the transparency for an object. When Adobe Distiller processes this PDFMark, it will set the transparency for the object. Lancaster offered an early discussion. (Start there rather than with the pdfmark Reference Manual.) Also, note that GhostScript supports transparency.
To get double spacing, use \usepackage{setspace} \doublespacing. This should leave your figures and tables alone.
If you use linerange markers with the listings package, make sure your markers do not include hyphens. (These will be treated as indicating the linerange break.)
\documentclass{article}
\usepackage[dvips]{geometry}
\begin{document}
\makeatletter\show\Gm@driver
\end{document}
This will insert dvips specials if you make a
dvi and pdftex specials if you make a pdf with pdflatex.
Similarly:
\documentclass{article}
\usepackage[dvipdf]{geometry}
\begin{document}
\makeatletter\show\Gm@driver
\end{document}
will insert dvipdfm specials if you make a dvi and pdftex specials if you
make a pdf with pdflatex.
The new pict2e package provides long awaited and much needed additional functionality to the LaTeX picture environment. As of June 2004, however, there is a small bug: be sure to end qbezier and cbezier commands with an immediate comment character, to avoid breaks in line continuity.
Using LaTeX to produce PDF files with graphics is pretty easy as long as you are producing clean graphics. But you need to pay attention to some details.
If you are producing your PDF files with dvipdfm, then you will find it easiest to use EPS graphics. (EPS is also the primary standard for publishers.) Historically this has been my preference, but lately I've been working more with pdflatex.
includegraphics
and putting the following in your preamble:
\ifx\pdfoutput\undefined
% we are running LaTeX, not pdflatex
\usepackage{graphicx}
\else
% we are running pdflatex, so convert .eps files to .pdf
\usepackage[pdftex]{graphicx}
\usepackage{epstopdf}
\fi
\documentclass{article}
\usepackage{graphicx}
\begin{document}
\begin{figure}[htp]
\centering
\includegraphics[width=\textwidth]{c:/temp.eps}
\caption{Test Figure}
\label{f:mytestfig}
\end{figure}
\end{document}
On the one hand it is easy enough to zip up all your EPS files with the embedding LaTeX document. On the other hand, one of the attractions of the LaTeX picture environment was that your drawings were present in your .tex file. Here is a way to get almost the same thing with EPS files. Add the moreverb package. Put your EPS file in a verbatimwrite environment in you .tex file. You will have to provide a file name that it will be written to, but once it is written you can read it into a figure as usual. (An alternatie is to generate your figures with embedded gnuplot commands, using the egplot package.)
\begin{wrapfigure}{R}{2in}
\includegraphics[width=2in]{example.eps}
\caption{Example Caption}
\label{fig:xmpl}
\end{wrapfigure}
name1+name2:date:journal
use the key name1.name2-date-journal.
name or id attribute
in an HTML or XML document.
The colon is allowed in HTML but is reserved in XML for namespace specification.
The plus-sign is not allowed in either specification.
XML allows a whole bunch on non-ASCII characters but HTML does not.
mankiw.etal-1994-qje)
so that your bib files remain useful to you years later.
month = jan,) so that months will end up correctly formatted.
(If you say, month="Jan.", it will always be formatted that way.)
Since gnuplot is a plotting package,
it offers limited data manipulation facilities.
These can be increased by the use of gawk,
which gnuplot can talk to nicely.
Alternatively you can manage your data in Python and use a Python interface to gnuplot:
SciPy includes the gplt module for this
(moved to the sandbox!)
but I prefer Gnuplot.py.
If you use IPython,
which is a good idea,
you can try the included enhanced version: Gnuplot2.py.
In either case,
if you use gnuplot's fit command,
you should consider how to get the results back into Python.
Be sure to use the valuable documentation that gnuplot includes. Begin by typing "help introduction" at the gnuplot prompt, since this explains the syntax used in the help documents.
Remember that gnuplot distinguishes integers and floats by the presence of a decimal point. Integer division produces an integer result, so $3/2=1$ but $3./2=1.5$.
Setting the color of plots is not well documented. Do it by setting the linetype variable. To see the linetypes, type test at the gnuplot command line.
To draw a 3-D scatterplot, try
splot 'data.asc' with points palette
You can draw a line segment by setting an arrow with the "nohead" parameter.
Be aware that division of integers takes place as integer division. E.g., 1/3=0. Make sure your real numbers are recognized as real by including a decimal point. E.g., 1./3 = 0.33333.
set log y 2.0 set format y '2^%L'
label command.
Use the 'front' option to make sure that they are placed after lines are plotted.
If you know the location,
you can also place a point as a data plot of a single value. E.g.,
plot '-' with points ps 3
1 1
e
centers a point at (1,1).
If you would like to use gnuplot to create a drawing with no plots in it this is possible.
Just be sure to set the yrange,
then plot 0/0 after all your drawing commands.
Up to version 3.8j, gnuplot arrowheads are not offset to account for their miter. This means they generally extend past the point where you expect them to stop. There is no satisfactory workaround, but you can try drawing a filled arrow with a very narrow pen and then redrawing just the tail (as a headless "arrow") with a thicker pen.
Kawano offers a brief overview of how to generate numerical plots using gnuplot.
I consider one extension to be indispensible: Session Manager. For FireFox version 3, I feel the same way about Taboo. (Taboo allows you to replace the practice of keeping many tabs open with a single page of site links.) In version 4, Pandora is an interesting alternative.
The default in Windows is to prevent you from seeing the extension to a filename. You can fix this as follows: open the Control Panel and open Folder Options, then pick the View tab and uncheck Hide File Extensions.
HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Control\ContentIndex\FilterFilesWithUnknownExtensions = 1
SHOW SPLASH SCREEN=0You can pre-empt certain misconfigured servers that do not correctly handle RFC2616 add the following to the [Adv User Prefs] section of opera6.ini:
HTTP Accept Charset=windows-1252, utf-8, utf-16, iso-8859-1, iso-8859-15;q=0.6, *;q=0.1
NPSVG6.DLL SVG6RFF.DLL SVG6RR.DLLRestart Opera and test the plugin at the Adobe SVG test page. You should see 3 animated images.
New LaTeX users on Windows may wish to read these hints
To include graphics in your document, use the graphicx package. Keep your images grouped together, and point to them with the \graphicspath command. (Some knowledgeable users suggest setting TEXINPUTS instead, e.g., http://www.latex-project.org/cgi-bin/ltxbugs2html?pr=latex/2618.) Note the odd syntax for \graphicspath: each path must be in braces and must end with a forward slash. If you want an images directory searched recursively (say because you put each chapters images a separate folder), end the path with a double slash. E.g., \graphicspath{{images-eps//}{images-pdf//}}.
See the LuaTeX manual.
Recent TeX distributions include LuaTeX.
The first thing most new users will wish to attemp with LuaTeX
is compilation of legacy LaTeX documents. You can compile a LaTeX document named
mydoc.tex with the command lualatex mydoc.
To enter arbitrary Unicode characters on a Windows platform, see
http://www.fileformat.info/tip/microsoft/enter_unicode.htm.
On Linux, consider the IBus input bus.
If you use Vim on either platform, see help utf-8-typing (and help digraphs-default).
GnuWin32 includes many useful GNU applications, including grep, sed, and awk. If you download everything (recommended), it will take a while.
Copyright © 1998&2008
by Alan G. Isaac
(mailto: a i s a a c @ a m e r i c a n . e d u)
Some Rights Reserved:
The content on this page is subject to the
Creative Commons Attribution License version 2.0