annotate doc_recap_some_important_thoughts_about_the_current_compiler.patch @ 141:85c2fa6f6bd8

Wrap-up wip
author Louis Opter <kalessin@kalessin.fr>
date Sat, 08 Feb 2014 18:28:44 -0800
parents
children cbff597d307e
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
141
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
1 # HG changeset patch
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
2 # Parent 01873f017f54a0c625261b8a1f27052219a00141
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
3 Recap important notes about the current compiler in a small document
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
4
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
5 This should be used as a work document for the next compiler version.
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
6
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
7 diff --git a/doc/rathaxes/technical/CMakeLists.txt b/doc/rathaxes/technical/CMakeLists.txt
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
8 --- a/doc/rathaxes/technical/CMakeLists.txt
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
9 +++ b/doc/rathaxes/technical/CMakeLists.txt
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
10 @@ -15,3 +15,5 @@
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
11 INSTALL(FILES ${CMAKE_CURRENT_BINARY_DIR}/technical_documentation_en.pdf
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
12 DESTINATION share/doc/rathaxes/)
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
13 ENDFOREACH(I ${DOCS})
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
14 +
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
15 +ADD_LATEX_DOCUMENT(rtx_2k12_wrap_up.tex DEFAULT_PDF MANGLE_TARGET_NAMES)
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
16 diff --git a/doc/rathaxes/technical/rtx_2k12_wrap_up.tex b/doc/rathaxes/technical/rtx_2k12_wrap_up.tex
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
17 new file mode 100644
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
18 --- /dev/null
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
19 +++ b/doc/rathaxes/technical/rtx_2k12_wrap_up.tex
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
20 @@ -0,0 +1,113 @@
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
21 +\documentclass[american]{rtxarticle}
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
22 +
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
23 +\title{Rathaxes 2012 wrap-up}
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
24 +
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
25 +\author{Louis Opter}
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
26 +
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
27 +\begin{document}
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
28 +
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
29 +\maketitle
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
30 +
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
31 +\begin{abstract}
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
32 +The second version of the Rathaxes compiler, \emph{Rathaxes 2012}, started in
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
33 +2010 has been sunset in 2013. This document aims to highlight the issues and
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
34 +the lessons learned while trying to recode an e1000 driver with this compiler
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
35 +version.
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
36 +
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
37 +This document should serve as a reference for the next version of the Rathaxes
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
38 +compiler implemented in Python 3 with Pyrser.
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
39 +\end{abstract}
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
40 +
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
41 +\section{Design issues}
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
42 +
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
43 +\subsection{Unused features}
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
44 +
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
45 +The following compiler features:
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
46 +
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
47 +\begin{itemize}
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
48 +\item Advanced chunk selection (using the \texttt{with} statement);
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
49 +\item Register declarations.
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
50 +\end{itemize}
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
51 +
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
52 +Turned out to unecessary because:
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
53 +
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
54 +\begin{itemize}
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
55 +\item We decided to scope the first driver to a single kernel (Linux 2.6.32 and
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
56 + then 3.2.0);
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
57 +\item Register declarations were not clearly wired to the rest of the language
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
58 + and were simply too advanced to be used at first;
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
59 +\item Challenges appeared at other places.
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
60 +\end{itemize}
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
61 +
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
62 +It's also interesting to note that sequences weren't used to define algorithms
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
63 +as planned but were re-fitted as ``functions'' as we started to write object
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
64 +oriented code around Rathaxes types. Some sequences are also used to logically
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
65 +regroup chunks and pointcut but those chunks could be moved to types or could
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
66 +directly be top-level declarations within their interface.
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
67 +
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
68 +\subsection{Features we missed}
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
69 +
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
70 +The following compiler features:
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
71 +
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
72 +\begin{itemize}
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
73 +\item ``Object model'';
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
74 +\item Ref/Scalar;
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
75 +\item Error handling;
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
76 +\item Variadic sequences;
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
77 +\item Arrays support;
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
78 +\item Comments passthrough;
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
79 +\item Type coercion to \texttt{Builtin::symbol}.
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
80 +\end{itemize}
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
81 +
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
82 +Are really needed.
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
83 +
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
84 +\subsubsection{``Object model''}
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
85 +
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
86 +The driver code started to organically organize itself into types with methods
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
87 +and attributes that loosely correspond to classes. We ran different into
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
88 +issues:
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
89 +
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
90 +\begin{itemize}
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
91 +\item Methods call aren't working;
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
92 +\item Type dependencies aren't resolved correctly, so they aren't generated in
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
93 + the right order;
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
94 +\item \texttt{\$\{self\}} is ambiguous, how do you know when it's a scalar or a
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
95 + method? (this is important to define the init method);
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
96 +\item Abstract data types should probably be framed/defined in the language;
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
97 +\item Mappings aren't resolved recursively;
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
98 +\item Mappings can't use Rathaxes code in them (e.g: you can't use
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
99 + \texttt{\$\{Rathaxes::Type.ref\}} in a mapping definition);
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
100 +\item Circular dependencies aren't supported (in e1000 the rings and the
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
101 + hardware context are inter-dependant, you can't avoid that);
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
102 +\item Type injections in upper sub-system (i.e: inject \texttt{e1000::Context}
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
103 + into \texttt{Ethernet::Device}), that has been implemented with regular
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
104 + pointcut but we need another kind of pointcut to only weave the type (and
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
105 + not the full structure field).
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
106 +\end{itemize}
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
107 +
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
108 +\subsubsection{Error handling}
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
109 +
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
110 +This has been deliberately left out in Rathaxes 2012 but it seems that the
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
111 +biggest difficulty is going to define and then inject the error handling code
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
112 +into the parent chunk/context appropriately.
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
113 +
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
114 +\section{Implementation issues}
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
115 +
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
116 +Some bugs are imparing development:
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
117 +
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
118 +\begin{itemize}
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
119 +\item Expansion bugs:
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
120 +\begin{itemize}
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
121 +\item Obscure expansion issues solved by scoping thigns;
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
122 +\item Variable declarations leaking across different chunks;
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
123 +\item Chunk/Pointcut parameters not bound to the C variables (the parameters
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
124 + must be named like the C variables are).
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
125 +\end{itemize}
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
126 +\item CNorm issues: it's impossible to use annotation (e.g: \texttt{\_\_init},
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
127 + \texttt{\_\_exit}, \texttt{\_\_iomem}, \ldots) or arbitrary typedef'd
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
128 + types;
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
129 +\item Some sequences call aren't working for obscure reasons (e.g:
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
130 + \texttt{DMA::unmap}).
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
131 +\end{itemize}
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
132 +
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
133 +\end{document}
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
134 diff --git a/rathaxes/samples/e1000/e1000.blt b/rathaxes/samples/e1000/e1000.blt
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
135 --- a/rathaxes/samples/e1000/e1000.blt
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
136 +++ b/rathaxes/samples/e1000/e1000.blt
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
137 @@ -809,7 +809,7 @@
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
138
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
139 chunk LKM::code()
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
140 {
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
141 - static int rtx_e1000_tx_ring_alloc_resources(${e1000::TxRing.ref} self)
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
142 + static int rtx_e1000_tx_ring_alloc_resources(${e1000:::TxRing.ref} self)
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
143 {
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
144 ${Log::info("e1000_tx_ring_alloc_resources: TBD...")};
85c2fa6f6bd8 Wrap-up wip
Louis Opter <kalessin@kalessin.fr>
parents:
diff changeset
145 return 0;