[Commit] nickle ChangeLog,1.90,1.91 lex.l,1.78,1.79

[Keith Packard]

Committed by: keithp

Update of /local/src/CVS/nickle
In directory home.keithp.com:/tmp/cvs-serv1329

Modified Files:
	ChangeLog lex.l 
Log Message:
2004-10-19  Keith Packard  <keithp at keithp.com>

	* lex.l:
	Permit any non-ASCII character in an identifier.  Better
	discrimination requires a better lexer generator as flex
	can't deal with UTF-8.


Index: ChangeLog
===================================================================
RCS file: /local/src/CVS/nickle/ChangeLog,v
retrieving revision 1.90
retrieving revision 1.91
diff -u -d -r1.90 -r1.91
--- ChangeLog	17 Oct 2004 23:34:34 -0000	1.90
+++ ChangeLog	20 Oct 2004 06:17:55 -0000	1.91
@@ -1,3 +1,10 @@
+2004-10-19  Keith Packard  <keithp at keithp.com>
+
+	* lex.l:
+	Permit any non-ASCII character in an identifier.  Better
+	discrimination requires a better lexer generator as flex
+	can't deal with UTF-8.
+
 2004-10-17  Keith Packard  <keithp at keithp.com>
 
 	* gram.y:

Index: lex.l
===================================================================
RCS file: /local/src/CVS/nickle/lex.l,v
retrieving revision 1.78
retrieving revision 1.79
diff -u -d -r1.78 -r1.79
--- lex.l	17 Oct 2004 23:34:34 -0000	1.78
+++ lex.l	20 Oct 2004 06:17:55 -0000	1.79
@@ -583,7 +583,7 @@
 		yylval.value = aetov (yytext, 10);
 		return TEN_FLOAT;
 		}
-[a-zA-Z_][0-9a-zA-Z_]* {
+[a-zA-Z\200-\377_][0-9a-zA-Z\200-\377_]* {
 	        CommandPtr	c;
 		SymbolPtr	symbol;
 		yylval.atom = AtomId (yytext);