# More # So far we have covered a majority of the various aspects of Python that you will use. In this chapter, we will cover some more aspects that will make our knowledge of Python more well-rounded. ## Passing tuples around ## Ever wished you could return two different values from a function? You can. All you have to do is use a tuple. ~~~ >>> def get_error_details(): ... return (2, 'second error details') ... >>> errnum, errstr = get_error_details() >>> errnum 2 >>> errstr 'second error details' ~~~ Notice that the usage of `a, b = ` interprets the result of the expression as a tuple with two values. If you want to interpret the results as `(a, )`, then you just need to star it just like you would in function parameters: ~~~ >>> a, *b = [1, 2, 3, 4] >>> a 1 >>> b [2, 3, 4] ~~~ This also means the fastest way to swap two variables in Python is: ~~~ >>> a = 5; b = 8 >>> a, b = b, a >>> a, b (8, 5) ~~~ ## Special Methods ## There are certain methods such as the `__init__` and `__del__` methods which have special significance in classes. Special methods are used to mimic certain behaviors of built-in types. For example, if you want to use the `x[key]` indexing operation for your class (just like you use it for lists and tuples), then all you have to do is implement the `__getitem__()` method and your job is done. If you think about it, this is what Python does for the `list` class itself! Some useful special methods are listed in the following table. If you want to know about all the special methods, [see the manual](http://docs.python.org/3/reference/datamodel.html#special-method-names). `__init__(self, ...)` : This method is called just before the newly created object is returned for usage. `__del__(self)` : Called just before the object is destroyed `__str__(self)` : Called when we use the `print` function or when `str()`is used. `__lt__(self, other)` : Called when the *less than* operator (<) is used. Similarly, there are special methods for all the operators (+, >, etc.) `__getitem__(self, key)` : Called when `x[key]` indexing operation is used. `__len__(self)` : Called when the built-in `len()` function is used for the sequence object. ## Single Statement Blocks ## We have seen that each block of statements is set apart from the rest by its own indentation level. Well, there is one caveat. If your block of statements contains only one single statement, then you can specify it on the same line of, say, a conditional statement or looping statement. The following example should make this clear: ~~~ >>> flag = True >>> if flag: print('Yes') Yes ~~~ Notice that the single statement is used in-place and not as a separate block. Although, you can use this for making your program *smaller*, I strongly recommend avoiding this short-cut method, except for error checking, mainly because it will be much easier to add an extra statement if you are using proper indentation. ## Lambda Forms ## A `lambda` statement is used to create new function objects. Essentially, the `lambda` takes a parameter followed by a single expression only which becomes the body of the function and the value of this expression is returned by the new function. Example (save as `lambda.py`): ~~~python points = [ { 'x' : 2, 'y' : 3 }, { 'x' : 4, 'y' : 1 } ] points.sort(key=lambda i : i['y']) print(points) ~~~ Output: ~~~ [{'x': 4, 'y': 1}, {'x': 2, 'y': 3}] ~~~ How It Works: Notice that the `sort` method of a `list` can take a `key` parameter which determines how the list is sorted (usually we know only about ascending or descending order). In our case, we want to do a custom sort, and for that we need to write a function but instead of writing a separate `def` block for a function that will get used in only this one place, we use a lambda expression to create a new function. ## List Comprehension ## List comprehensions are used to derive a new list from an existing list. Suppose you have a list of numbers and you want to get a corresponding list with all the numbers multiplied by 2 only when the number itself is greater than 2. List comprehensions are ideal for such situations. Example (save as `list_comprehension.py`): ~~~python listone = [2, 3, 4] listtwo = [2*i for i in listone if i > 2] print(listtwo) ~~~ Output: ~~~ $ python3 list_comprehension.py [6, 8] ~~~ How It Works: Here, we derive a new list by specifying the manipulation to be done (`2*i`) when some condition is satisfied (`if i > 2`). Note that the original list remains unmodified. The advantage of using list comprehensions is that it reduces the amount of boilerplate code required when we use loops to process each element of a list and store it in a new list. ## Receiving Tuples and Dictionaries in Functions ## There is a special way of receiving parameters to a function as a tuple or a dictionary using the * or ** prefix respectively. This is useful when taking variable number of arguments in the function. ~~~ >>> def powersum(power, *args): ... '''Return the sum of each argument raised to specified power.''' ... total = 0 ... for i in args: ... total += pow(i, power) ... return total ... >>> powersum(2, 3, 4) 25 >>> powersum(2, 10) 100 ~~~ Because we have a `*` prefix on the `args` variable, all extra arguments passed to the function are stored in `args` as a tuple. If a ** prefix had been used instead, the extra parameters would be considered to be key/value pairs of a dictionary. ## The assert statement ## The `assert` statement is used to assert that something is true. For example, if you are very sure that you will have at least one element in a list you are using and want to check this, and raise an error if it is not true, then `assert` statement is ideal in this situation. When the assert statement fails, an `AssertionError` is raised. ~~~ >>> mylist = ['item'] >>> assert len(mylist) >= 1 >>> mylist.pop() 'item' >>> mylist [] >>> assert len(mylist) >= 1 Traceback (most recent call last): File "", line 1, in AssertionError ~~~ The `assert` statement should be used judiciously. Most of the time, it is better to catch exceptions, either handle the problem or display an error message to the user and then quit. ## Decorators ## Decorators are a shortcut to applying wrapper functions. This is helpful to "wrap" functionality with the same code over and over again. For example, I created a `retry` decorator for myself that I can just apply to any function and if any exception is thrown during a run, it is retried again, till a maximum of 5 times and with a delay between each retry. This is especially useful for situations where you are trying to make a network call to a remote computer: ~~~python from time import sleep from functools import wraps import logging logging.basicConfig() log = logging.getLogger("retry") def retry(f): @wraps(f) def wrapped_f(*args, **kwargs): MAX_ATTEMPTS = 5 for attempt in range(1, MAX_ATTEMPTS + 1): try: return f(*args, **kwargs) except: log.exception("Attempt %s/%s failed : %s", attempt, MAX_ATTEMPTS, (args, kwargs)) sleep(10 * attempt) log.critical("All %s attempts failed : %s", MAX_ATTEMPTS, (args, kwargs)) return wrapped_f counter = 0 @retry def save_to_database(arg): print("Write to a database or make a network call or etc.") print("This will be automatically retried if exception is thrown.") global counter counter += 1 if counter < 2: raise ValueError(arg) if __name__ == '__main__': save_to_database("Some bad value") ~~~ Output: ~~~ $ python3 retry_decorator.py Write to a database or make a network call or etc. This will be automatically retried if exception is thrown. ERROR:retry:Attempt 1/5 failed : (('Some bad value',), {}) Traceback (most recent call last): File "/tmp/retry_decorator.py", line 14, in wrapped_f return f(*args, **kwargs) File "/tmp/retry_decorator.py", line 37, in save_to_database raise ValueError(arg) ValueError: Some bad value Write to a database or make a network call or etc. This will be automatically retried if exception is thrown. ~~~ How It Works: Read . ## Differences between Python 2 and Python 3 ## Read these articles: - [Armin's Porting to Python 3 Redux](http://lucumr.pocoo.org/2013/5/21/porting-to-python-3-redux/) - [PyDanny's Python 3 experience](http://pydanny.com/experiences-with-django-python3.html) - [Official Django Guide to Porting to Python 3](https://docs.djangoproject.com/en/dev/topics/python3/) ## Summary ## We have covered some more features of Python in this chapter and yet we haven't covered all the features of Python. However, at this stage, we have covered most of what you are ever going to use in practice. This is sufficient for you to get started with whatever programs you are going to create. Next, we will discuss how to explore Python further.